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Executive  Summary 


This  research  project  has  successfully  investigated  the  use  of  high-dimensional  M-ary 
orthogonal  signal  sets  with  trellis-coded  modulation  (TCM)  in  order  to  achieve 
significant  improvement  in  the  performance  of  spread-spectrum  communication  systems. 

The  advantages  derived  from  this  work  can  be  applied  directly  to  improve  the 
performance  of  anti-jam  (AJ)  and/or  low  probability  of  intercept  (LPI)  communication 
systems  for  military  applications.  In  addition,  this  work  would  also  has  potential 
advantages  in  commercial  code-division  multiple  access  (CDMA)  networks. 

Trellis  Coded  Modulation  (TCM)  is  a  technique  which  combines  the  error  correction  and 
modulation  functions  of  the  communication  system,  to  achieve  significant  gains  in 
system  performance.  This  is  accomplished  by  using  an  m-ary  signal  set  (termed  a 
constellation  of  signals),  which  is  partitioned  into  sub-constellations,  and  representing  the 
transmitter  as  a  finite  state  machine.  The  data  symbols  at  the  transmitter  are  mapped  onto 
a  sub-constellation  in  order  to  select  the  transmitted  symbol.  The  sub-constellation  is 
determined  by  the  current  "state"  of  the  transmitter,  and  state  transitions  occur  as  each 
symbol  is  transmitted.  While  all  symbols  in  the  constellation  are  used  with  equal 
probability  over  time  (assuming  random  data),  only  certain  sequences  of  symbols  can 
occur,  due  to  the  structure  of  the  finite  state  machine  model.  Knowledge  of  these 
sequential  restrictions  is  used  by  the  receiver  to  choose  the  most  likely  valid  sequence, 
which  enables  significant  error  correction  to  occur  at  the  receiver.  The  improved 
performance  is  primarily  due  to  the  fact  that  decisions  are  made  according  to  a  Euclidean 
distance  criteria,  as  opposed  to  a  Hamming  distance  criteria.  This  is  inherent  in  a  system 
which  combines  modulation  and  coding,  and  is  somewhat  analogous  to  soft  decision 
decoding. 

Traditionally,  TCM  has  been  used  on  band-limited  channels,  in  order  to  achieve  higher 
data  rates.  The  classic  example  of  this  is  high-rate  telephone  modems  (56  Kbits/sec  over 
a  3  KHz.  channel).  This  is  accomplished  with  a  large  constellation  of  symbols  in  a  2 
dimensional  signal  space  (i.e.  inphase  and  quadrature).  This  places  the  signals  in  the 
constellation  "close"  together  (i.e.  they  are  not  orthogonal)  and  thus  more  power  is 
required  to  achieve  acceptable  error  performance.  Thus,  TCM  is  used  very  effectively  in 
this  case  to  improve  bandwidth  efficiency,  at  the  expense  of  power  efficiency  (a  good 
trade-off  for  the  band- limited  telephone  modem  channel). 

In  general,  there  are  two  widely  used  algorithms  for  decoding  convolutional  or  trellis 
codes;  the  well  known  Viterbi  algorithm,  and  the  BCJR  algorithm.  In  a  generalized  sense, 
both  of  these  algorithms  are  mathematically  equivalent,  and  in  fact  both  algorithms 
belong  to  a  larger  class  of  algorithms  referred  to  as  “dynamic  programming”  algorithms. 
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The  Viterbi  algorithm  has  enjoyed  wide  commercial  success,  as  the  decoder  of  choice  for 
convolutional  codes  in  satellite  systems,  digital  cell  phones,  and  telephone  modems,  to 
name  only  a  few  of  its  applications. 

The  BCJR  algorithm,  after  having  been  ignored  for  years,  has  become  popular  recently 
for  the  decoding  of  turbo  codes  (or  parallel  concatenated  codes)  which  require  an 
iteration  between  two  permuted  code  sequences. 

The  decoding  algorithm  which  has  been  implemented  for  CTCM  is  based  on  the  BCJR 
algorithm,  with  several  key  modifications  which  I  will  describe  below.  A  tutorial  of  the 
standard  BCJR  algorithm,  as  well  as  detailed  modifications,  is  included  in  the  Appendix. 

I  should  point  out  that  at  this  point,  my  initial  implementation  of  the  BCJR  algorithm 
achieves  excellent  bit-error-rate  performance,  but  is  not  optimized  for  execution  speed,  as 
would  need  to  be  done  in  a  commercially  viable  system.  Work  on  improving  the  speed  of 
this  implementation  is  underway,  and  I  believe  that  some  additional  patentable  ideas  will 
result. 


The  following  are  enhancements  to  the  standard  BCJR  algorithm  successfully 
implemented  and  tested  under  this  contract. 

Dealing  with  an  Unknown  Initial  State 

Conventional  trellis  decoding  algorithms  assume  that  the  encoder  and  decoder  both  start 
in  an  agreed  upon  initial  state.  With  the  unknown  initial  state  of  TBCM,  and  the  strong 
tailbiting  property,  this  is  not  possible.  The  solution  is  to  simply  set  all  initial  state 
probabilities  as  equally  likely  for  the  first  iteration  of  the  decoder,  and  allow  the  decoder 
to  converge  naturally  on  the  correct  initial  state. 

Dealing  with  non-binary  data  symbols. 

The  trellis  used  for  TBCM  is  non-binary  in  a  general  sense.  The  current  implementation 
uses  a  4-ary  source  alphabet,  but  other  sizes  could  easily  be  accommodated.  In  general, 
m-ary  source  alphabets  are  accommodated  by  structuring  the  encoder/decoder  with  a 
look-up  table  implementation  which  includes  both  the  state  transitions  and  the  the 
channel  symbols,  and  can  be  easily  modified  to  accommodate  any  new  trellis  structure  or 
symbol  constellation. 

Dealing  with  the  absence  of  the  data  stream  in  the  encoded  bit  stream  (i.e.  nonsystematic 
constituent  codes) 

Published  descriptions  of  the  implementation  of  turbo  decoders  refer  to  the  permuted 
“common”  or  “extrinsic”  information  which  is  used  in  the  feedback  iteration  process  to 
improve  the  state  estimates  of  the  parallel  decoders.  In  this  code,  the  common 
information  is  not  explicit  in  the  data  stream,  and  must  be  inferred  indirectly  by  the 
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algorithm.  This  is  accomplished  by  summing  the  individual  transition  probabilities  at 
eaeh  stage  of  the  trellis  prior  to  the  permuted/depermuted  feedbaek  stage,  in  order  to 
obtain  an  estimate  of  the  extrinsie  information. 

Permutation  of  symbol  sequenees 

Rather  than  permuting  individual  symbols  at  the  eneoder,  groups  of  symbols,  of  size  M 
are  permuted.  The  deeoder  is  then  struetured  to  estimate  the  states  between  sequenees  of 
M  symbols,  rather  than  the  states  between  individual  symbols.  This  results  in  an 
improvement  in  bit-error  performanee,  but  the  eost  is  greater  eomputational  eomplexity. 
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Chapter  1  INTRODUCTION 


1,1  History  of  Research  on  CTCM 

Trellis  coding  is  a  popular  error  correcting  technology  in  modern  digital 
communications.  An  important  technique  used  in  trellis  coding  is  trellis  termination  that 
forces  the  encoded  trellis  path  to  satisfy  the  state  constraint— the  starting  state  and  ending 
state  should  be  the  same  [1].  In  shift-register  based  trellis  coding  environment,  the  initial 
state  of  encoder  is  always  assumed  to  be  0  state  and  zero  tailing  [1]  [2]  is  used  for  trellis 
termination.  In  this  method,  a  certain  number  of  zeros  are  padded  to  the  end  of  the 
terminated  input  data  sequence  to  force  the  encoded  trellis  path  to  end  at  0  state. 
However,  code  rate  is  reduced  due  to  these  padding  zeros.  It  becomes  significant  when 
the  input  information  sequence  has  short  length. 

An  alternative  to  trellis  termination  without  code  rate  loss  is  tail  biting,  first 
introduced  by  Solomon  and  Van  Tilborg  [3]  and  generalized  later  by  Howard  H.  Ma  et 
al.  [2].  The  state  constraint  is  satisfied  by  forcing  every  trellis  path  to  be  a  circular  path— a 
path  having  the  same  starting  state  and  ending  state,  which  can  be  any  of  the  possible 
states  in  the  trellis.  Its  implementation  involves  initializing  the  encoder  to  a  certain  state 
with  the  last  certain  number  of  information  bits  in  the  input  information  sequence.  For  a 
long  time,  zero  tailing  has  been  the  only  practically  used  trellis  termination  method 
because  of  the  simplicity  and  the  fact  that  many  efficient  decoding  algorithms  were 
invented  based  on  that  condition. 

With  the  recent  development  of  turbo  codes  [4]  and  the  requirement  of  short 
frame  transmission  [5]  [6],  trellis  termination  began  to  be  addressed  again  [7]  [8].  A 
novel  circular  trellis  coding  with  a  permuted  state  structure  was  invented  [9]  [10]  [11].  A 
permuted  state  transition  table  is  built  to  guarantee  the  state  constraint.  Any  input  data 
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block  is  uniquely  mapped  to  a  eireular  trellis  path  under  this  state  transition  table.  This  is 
done  without  eode  rate  loss  or  initializing  the  eneoder. 

Sinee  Ungerboek  introdueed  trellis-eoded  modulation  (TCM)  in  1982  [12],  eoded 
modulation  has  been  extensively  researehed  and  has  aehieved  remarkable  eommereial 
sueeess  in  its  applieations  in  band-limited  ehannels.  TCM  eombines  a  state-oriented 
trellis  eoding  seheme— usually  a  eonvolutional  eoding  seheme— and  a  multi-level/phase 
modulation  into  one  single  proeess.  Coding  gain  is  aehieved  without  bandwidth 
expansion.  Ungerboek’s  work  eventually  led  to  eoded  modulation  sehemes  eapable  of 
operation  near  eapaeity  in  a  band-limited  ehannel  [13]. 

Applying  the  eoneept  of  eonventional  TCM,  eireular  trellis  eoded-modulation 
(CTCM)  with  the  permuted  state  strueture  for  power-limited  spread  speetrum  ehannels 
has  been  investigated  in  [9]  [10]  [11]  [14].  In  these  literatures,  orthogonal,  bi-orthogonal, 
and  simplex  signal  eonstellations  have  been  researehed  for  very  small  trellises.  Sinee 
there  is  no  systematie  proeedure  for  signal  eonstellation  eonstruetion  and  symbol 
assignment,  those  works  eannot  be  extended  to  large  trellis  for  praotieal  applieations. 
Neither  ean  systematie  analysis  be  done  on  the  distanee  property,  whieh  is  the  most 
importanee  parameter  for  an  error  eorreeting  eode. 

Effieient  deeoding  algorithms  were  developed  for  TCM  [15]  [16]  [17]  [18].  The 
most  used  is  Viterbi  algorithm  [15],  whieh  is  the  optimum  deeoding  to  minimize  the  eode 
word  error  [19]  [20].  The  other  optimum  algorithm,  whieh  minimizes  the  symbol  (bit) 
error,  is  BCJR  algorithm  [21].  These  algorithms  require  that  the  starting  trellis  state  or  the 
distribution  of  the  starting  states  be  known  a  priori.  The  unknown  starting  state  in  CTCM 
makes  these  deeoding  algorithms  not  direetly  applieable.  Maximum  likelihood  (ML) 
deeoding  ean  always  be  used,  but  only  for  input  information  sequenees  with  small  length. 
No  effieient  deeoding  algorithm  exists  in  the  literature  for  eurrent  CTCM  with  permuted 
state  strueture.  A  eireular  BCJR  algorithm  was  developed  reeently  for  tail  biting  eodes 
[22],  whieh  ean  be  useful  in  CTCM  with  permuted  state  strueture. 
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1,2  Contributions  of  this  Research 


In  this  research,  a  systematic  high  dimensional  CTCM  with  permuted  state 
structure  (HDCTCM)  is  developed.  The  systematic  designs  of  a  high  dimensional 
simplex  signal  constellation  and  symbol  assignment  procedure  are  invented  to  achieve 
optimal  energy  efficiency  for  power-limited  channels  [23]. 

Minimum  distance  of  a  code  is  a  primary  parameter  in  determining  its  error 
correcting  capacity  [24].  Conventional  algorithms  [25]  [26]  to  calculate  the  minimum 
distance  of  a  trellis  code  always  assume  that  the  starting  state  is  known  a  prior,  which  is 
not  true  for  circular  trellis  coding.  This  research  develops  a  practical  computational 
algorithm  to  calculate  the  minimum  distance  of  circular  trellis  coding  [27].  The  minimum 
distance  of  HDCTCM  is  obtained  using  this  algorithm.  The  coding  gain  of  HDCTCM  is 
evaluated  after  the  minimum  distance  is  obtained. 

Due  to  the  systematic  construction  of  the  signal  constellation  and  symbol 
assignment,  upper  and  lower  bonds  are  derived  for  HDCTCM  codes  [28].  Also,  this 
research  proves  these  bounds  can  be  reached.  And  a  method  to  build  codes  that  have  the 
bounds  of  minimum  distance  is  developed  [29],  whereas  in  most  coding  scheme,  the 
optimal  distance  codes  can  only  be  obtained  through  exhaustive  search. 

Moreover,  the  circular  BJCR  algorithm  is  explored  for  decoding  HDCTM. 
Several  implementation  issues  are  solved.  Tentative  hard  decision,  along  with  the 
reliability  information,  is  used  to  statistically  evaluate  the  starting  state.  The  circular 
property  is  incorporated  into  this  algorithm  to  select  the  most  reliable  symbol  as  the 
starting  point  in  the  decoding. 


1,3  Outline  of  this  Dissertation 

In  this  dissertation,  the  background  knowledge  on  trellis  coding,  TCM,  CTCM 
with  permuted  state  structure,  Viterbi  and  BCJR  algorithms  are  given  in  Chapter  2.  In 
Chapter  3,  the  systematic  designs  of  signal  constellation  and  symbol  assignment  for 
HDCTCM  are  introduced.  The  proof  of  uniformity  of  this  coded  modulation  scheme  is 
presented  as  well.  Chapter  4  derives  the  computational  algorithm  to  calculate  the 
minimum  distance  for  circular  trellis  codes.  In  addition,  the  distance  property  shown  by 
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HDCTCM  using  this  algorithm  is  illustrated.  Chapter  5  derives  the  upper  and  lower 
bounds  of  the  minimum  distanee  of  HDCTCM  and  designs  the  proeedure  to  build  the 
eodes  that  aehieve  the  bounds  of  minimum  distanee.  The  possible  distanee  distributions 
of  optimum  eodes  are  also  diseussed  in  this  ehapter.  Chapter  6  explores  iterative  eireular 
BCJR  for  deeoding  HDCTCM.  Implementation  issues  are  solved  in  this  ehapter.  An 
iterative  eireular  shift  BCJR  is  developed  for  deeoding  HDCTCM.  The  properties  of  this 
deeoding  algorithm  are  demonstrated  through  simulations  and  eomparisons  with  other 
deeoding  algorithms.  The  error  performanee  of  HDCTCM  using  this  deeoding  algorithm 
is  analyzed  as  well.  Chapter  7  presents  the  eonelusions  and  reeommends  some  further 
researeh  in  a  number  of  speeifie  direetions. 
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CHAPTER!  BACKGROUND 


This  chapter  provides  the  baekground  materials  on  trellis  eoding,  eonventional 
TCM,  eireular  trellis  eoding  with  permuted  state  strueture,  and  deeoding  algorithms  for 
TCM. 

2.1  Error  Control  Coding 

This  dissertation  work  falls  into  the  area  of  error  eontrol  eoding.  In  this  seetion, 
the  related  stages  to  this  researeh  in  digital  eommunieation  system  are  diseussed,  and  then 
the  representation  of  error  eontrol  eodes  is  given. 

2.1.1  Communication  System  Overview 

A  digital  eommunieation  system  ean  be  deseribed  by  the  simplified  Figure  2.1. 
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Figure  2.1  Simplified  digital  communication  system 


The  stages  related  to  this  researeh  are  Channel  Eneode/Deeode, 
Modulation/Demodulation  and  Spread/Despread.  The  input  to  the  ehannel  eneoder  is 
assumed  to  be  the  output  of  the  souree  eneoder  and  is  ealled  the  information  sequenee. 
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Channel  coding  transforms  the  information  sequence  to  a  sequence  of  code 
symbols  called  code  sequence  or  code  word.  The  transformation  is  designed  to  improve 
communication  performance  by  enabling  the  code  sequence  to  better  withstand  various 
channel  impairments,  such  as  noise,  fading,  and  jamming.  The  modulator  maps  the  code 
sequence  to  a  sequence  of  channel  symbols  drawn  from  a  signal  constellation.  Channel 
symbols  are  realized  by  analog  waveforms  to  be  transmitted  over  the  channel.  In  this 
dissertation,  the  channel  is  assumed  to  be  a  discrete  memoryless  channel  (DMC)  with 
additive  white  Gaussian  noise  (AWGN).  The  demodulator  makes  a  definite  decision 
(hard  decision)  or  a  quantized  approximation  (soft  decision)  for  each  received  symbol  to 
one  of  the  symbols  in  the  signal  constellation.  Those  symbol  values  are  fed  into  the 
decoder  to  decide  the  code  sequence  and  the  corresponding  information  sequence. 
Spreading  maps  the  signals  into  an  extended  time  or  frequency  range  according  to  a 
certain  mapping  function  before  transmission.  This  has  advantages  in  many  aspects,  such 
as  anti-jamming.  Despreading  extracts  the  signal  before  spreading.  More  detailed 
structure  and  functionality  of  each  stage  can  be  referred  to  in  [1]. 

2,1.2  Representation  of  Error  Control  Codes 

A  basic  kind  of  channel  coding  is  error  control  coding.  It  introduces  a  controlled 
redundancy  to  the  information  sequence  to  provide  the  transmitted  code  sequence  with 
improved  ability  to  combat  error  and  provide  a  way  for  the  receiver  to  detect  or  correct 
error  during  transmission  over  a  noisy  channel.  Error  control  codes  can  be  divided  into 
two  general  categories;  block  codes  and  convolutional  codes. 

In  block  coding,  the  information  sequence  is  segmented  into  blocks  of  fixed 
length  k.  The  encoder  transforms  each  block  of  k  information  symbols  to  a  r  -tuple  vector 
known  as  code  word  according  to  a  certain  rule  defined  by  a  generator  matrix  or 
polynomial.  A:  /  r  is  defined  as  code  rate— a  measure  of  information  bit  (symbol)  per  code 
bit  (symbol),  {r-k)  bits  are  the  redundancy  bits  (symbols)  added  to  perform  error 
detection  or  correction.  The  encoder  encodes  each  k  information  symbols  independently. 
Most  decoding  methods  for  block  codes  are  algebraic  operations  such  as  syndrome 
decoding  for  linear  block  codes  [30]. 
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Convolutional  codes  were  first  introdueed  by  Elias  in  1955  [31].  Convolutional 
eodes  differ  from  bloek  eodes  in  that  the  eneoder  eontains  memory  so  that  the  r  -tuple 
eneoder  output  at  any  given  time  depends  not  only  on  the  A: -tuple  input  at  that  time 
instanee  but  also  on  the  previous  if  input  A: -tuples.  K  is  defined  as  eonstraint  length 
(sometimes  termed  as  memory  order).  An  {k  ,r  ,K)  eonvolutional  eode  ean  be 
implemented  with  a  A: -input,  r -output  linear  sequential  eireuit  with  input  memory  K, 
with  if  =  maXj<;<j.A'. ,  where  K.  is  the  number  of  the  delay  elements  in  the  1)^,  shift 
register.  The  rate  k !  r  has  the  same  eode  rate  signifieanee  as  bloek  eodes.  A  binary 
(2,1,2)  eneoder  is  shown  in  Figure  2.2. 


vi  First  code  symbol 


Figure  2.2  A  (2,1,2)  binary  convolutional  encoder 


A  set  of  polynomials  indieating  the  eonneetions  between  the  adders  and  the  stages 
of  the  registers  eompletely  deseribes  the  eneoder.  It  is  ealled  the  polynomial 
representation.  The  other  two  frequently  used  representations  are  state  diagram  and 
trellis  diagram.  Viewing  the  eonvolutional  eneoder  as  a  finite  state  maehine  driven  by  the 
information  sequenee,  a  state  diagram  illustrates  the  state  transitions  related  to  eaeh 
possible  k  -tuple  input.  Figure  2.3  is  the  state  diagram  for  the  eneoder  shown  in  Figure 
2.2.  The  braneh  is  labeled  by  the  k  -tuple  input  string  together  with  the  output  eode  word. 
Denote  the  eneoder  state  at  time  (  as  S', ,  then  the  eneoder  is  said  to  be  Markov  in  the 
sense  that  the  probability,  ,  of  being  in  state  given  all  the 

previous  states,  depends  only  on  the  most  reeent  state  S. ,  that  is,  the  probability  is  equal 
toF(^.,JS,). 
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By  extending  a  state  diagram  along  the  time  dimension  and  merging  the  same 
state  at  the  same  time  instanee,  a  trellis  diagram  ean  be  obtained.  Figure  2.4  is  the  trellis 
diagram  for  the  eneoder  in  Figure  2.2. 


Figure  2,3  State  diagram  for  the  encoder  in  Figure  2,2 

A  node  in  a  trellis  denotes  a  state.  A  braneh  represents  a  state  transition  driven  by 
a  eertain  input  information  string.  It  is  labeled  by  a  eode  symbol  the  eneoder  outputs 
when  that  state  transition  oeeurs.  The  level  of  trellis  at  time  to  is  0,  and  it  inereases  by  one 
at  eaeh  time  instanee.  From  a  starting  state,  all  the  states  will  be  reaehed  after  a  eertain 
trellis  level  and  then  a  fixed  trellis  seetion  prevails.  This  trellis  seetion  eompletely 
deseribes  the  eodes.  A  eode  word  eorresponding  to  an  information  sequenee  is 
represented  by  a  sequenee  of  state  transitions  along  the  time  dimension,  whieh  is  named 
as  a  trellis  path. 
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Figure  2.4  Trellis  diagram  for  the  encoder  in  Figure  2.2 

Any  encoder  described  by  a  finite  state  machine  can  be  represented  by  a  trellis 
and  is  named  trellis  encoder.  Convolutional  codes  are  the  earliest  linear  codes  in  the  class 
of  trellis  codes.  We  will  investigate  the  circular  trellis  codes  in  this  dissertation.  Circular 
trellis  encoder  refers  to  a  type  of  trellis  encoder,  in  which  each  information  sequence  is 
mapped  to  a  circular  trellis  path— a  path  having  the  same  starting  state  and  ending  state. 
This  state  can  be  any  of  the  total  states  in  this  trellis  and  is  completely  determined  by  the 
information  sequence  itself. 

All  the  information  conveyed  by  state  diagram  and  trellis  diagram  can  be  recorded 
in  a  table,  called  state  transition  table.  It  indicates  the  next  state  of  the  state  transition 
originating  from  any  of  the  total  states  and  driven  by  all  the  possible  A: -tuple  inputs. 
Building  a  trellis  codes  is  to  specify  its  state  transition  table. 

2.2  Trellis  Termination 

In  trellis  coding,  the  information  sequence  is  truncated  periodically  with  length  L 
to  have  a  block  structure.  In  order  to  provide  the  same  error  protection  to  the  last 
information  symbol,  a  technique  called  trellis  termination  is  employed  to  force  the 
encoded  trellis  path  to  satisfy  a  state  constraint— the  starting  and  ending  states  of  a  trellis 
path  should  be  the  same.  Zero  tailing,  tail  biting,  and  circular  trellis  with  permuted  state 
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structure  are  the  three  ways  to  do  this.  They  are  introdueed  in  the  following  two 
subseetions. 

2.2.1  Zero  Tailing  and  Tail  Biting 

For  a  trellis  eode,  usually  0  state  is  assumed.  0  state  eorresponds  to  the  situation 
that  the  eontents  of  the  shift  register  are  all  zeros  initially.  Zero  tailing  is  used  for  trellis 
termination.  A  eertain  number  of  zeros  are  appended  to  the  truneated  information 
sequenee  to  foree  the  eneoded  trellis  path  to  go  baek  to  0  state.  For  ease  of  understanding, 
eonsider  a  binary  {\,r,K)  eonvolutional  eode.  In  this  ease,  K  zeros  are  needed  to 
append.  For  an  information  sequenee  of  length  L ,  the  resultant  eode  is  a  {{L  +  K)r,L) 
bloek  eode  of  rate  (1  /  r)(L  /  (L  +  K))  =  (1  /  r)(l  -  K  /  (L  +  K)) .  The  term  K  /  (L  +  K)  is 
ealled  the  rate  loss  due  to  zero  tailing.  To  reduee  the  rate  loss,  the  truneation  period  L  is 
generally  made  as  long  as  permissible. 

An  alternative  that  does  not  introduee  eode  rate  loss  is  tail  biting.  For  a  binary  (1, 
r  ,K)  eneoder,  first  initialize  the  eneoder  by  inputting  the  last  K  information  bits  of  the 
information  sequenee  into  the  eneoder  and  ignore  the  output,  then,  input  all  L 
information  bits  and  take  the  resultant  L  ■  r  output  bits  as  eode  word.  The  last  K 
information  bits  will  foree  the  eneoded  path  to  go  baek  to  the  initial  state  of  the  eneoder. 
This  state  is  fully  determined  by  the  input  data  sequenee  itself  It  is  a  type  of  eireular 
trellis  eoding.  The  resulting  eode  is  a  ( T ,  L-r)  bloek  eode  of  rate  Hr. 

For  a  long  time,  zero  tailing  is  the  dominant  praetieal  method  for  trellis 
termination  beeause  of  its  simplieity  and  the  faet  that  many  effieient  deeoding  algorithms 
were  developed  based  on  this  assumption.  Tail  biting  is  only  used  for  researeh  to 
assoeiate  quasi-eyelie  bloek  eodes  with  eonvolutional  eodes  in  order  to  apply 
eonvolutional  deeoding  algorithm  to  bloek  eodes  [3]. 

2.2.2  Circular  Trellis  Coding  with  Permuted  State  Structure 

A  novel  eireular  trellis  eoding  with  permuted  state  strueture  was  invented 
reeently.  The  state  eonstraint  is  satisfied  without  eode  rate  loss  or  initializing  the  eneoder. 
It  is  done  by  designing  a  permuted  state  transition  table  for  the  eneoder. 
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Denote  a  eireular  trellis  as  T {n,  D) ,  where  n  is  the  number  of  exiting  branehes 
from  eaeh  state.  D  is  ealled  trellis  depth;  it  is  the  number  of  stages  needed  to  reaeh  all  the 
possible  states  from  a  starting  state.  This  starting  state  ean  be  any  of  the  total  states  in  this 
trellis.  When  the  eneoder  aeeepts  one  q-ary  information  symbol  at  one  time  (this  is  the 
ease  for  eireular  trellis  eoding  with  permuted  state  strueture),  n  =  q ,  i.e.,  the  size  of  the 
information  symbol  alphabet.  When  it  aeeepts  A: -tuple  q-ary  inputs  at  one  time,  n  =  q’' . 
In  either  ease,  the  total  number  of  states  in  this  trellis  is  S  =  n^ . 

The  state  transition  table  is  built  using  Zeeh’s  logarithm  operation  in  finite  field— 
GF(5').  Number  the  total  Estates  as  oo,  1,  2,  ...,  5*- 1. 

Then  in  GF(5'),  “a  nature  (1,  S-  l)-type  permutation”  is  expressed  as 
rT^=(a))(l  2  3  ...  5-2  5-1)  (2.1) 

It  represents  the  state  transition  oo^oo,  I^2^3^...^5-2^5-I^I;  they  are 
named  as  I  -eyele  and  (5-1  )-eyele  ordered  state  permutation,  respeetively. 

The  left  5-l“(l,  S-l)-type  permutation”  in  GF(5)  ean  be  built  by  using  Zeeh’s 
logarithm  operation.  Denote  them  as 

0,  =(0(z(l)+/  z(2)  +  /  z(3)  +  /  ...  z(5-3)  +  /  z(5-2)  +  /  oo  ),  /  =  1,2,...,5 - 1  (2.2) 
The  state  transition  it  represents  is 

i  — ^  i ,  z(l)  +  i  — ^  ^(2)  +  i  — ^  ^(3)  "t  i  — ^  ...  — ^  z(^S ~  3)  +  i  — ^  z(^S  —  2)  +  i  — ^  go  — ^  ^(1)  "t  i  •  By 
properly  ehoosing  n  out  of  the  5  “(1,  S-l)-type  permutation”  and  letting  eaeh  of  them 
assoeiate  with  the  state  transitions  driven  by  one  of  the  n  information  symbol  alphabets, 
the  state  transition  table  is  eonstrueted.  This  state  transition  table  guarantees  that  eaeh 
information  sequenee  of  length  L>  D+ I  will  be  mapped  to  a  eireular  trellis  path,  and  the 
starting  and  ending  state  of  this  path  is  a  funetion  of  the  symbols  in  the  information 
sequenee.  No  zero  padding  or  eneoder  initialization  is  needed  in  this  eoding  seheme. 

2,3  Trellis-Coded  Modulation 

The  goal  of  ehannel  eoding  is  to  aehieve  eoding  gain.  Coding  gain  is  defined  as 
the  reduetion  in  the  required  /  Nq  to  aehieve  a  speeified  error  probability  using  the 
eoded  system  versus  an  uneoded  system.  Where  F’j  is  the  average  bit  energy  of  the  input 
data,  Nq  is  the  one-sided  power  speetrum  density  of  ehannel  noise. 
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In  conventional  communication,  coding  and  modulation  are  separate  processes. 
The  eoding  gain  is  aehieved  at  the  priee  of  bandwidth  expansion  by  transmitting  r -tuple 
eode  word  instead  of  A: -tuple  data  bloek  in  the  same  time  slot.  TCM  combines  them  into 
one  proeess.  Conventional  TCM  has  been  widely  used  in  band-limited  channels.  With  the 
development  of  spread  spectrum  communications,  coded  modulation  for  power-limited 
spread  spectrum  channels  becomes  the  latest  research  interest.  CTCM  with  permuted 
state  structure  was  introduced.  We  will  give  a  brief  review  on  these  two  schemes. 


2,3.1  Conventional  TCM 

TCM  was  invented  to  achieve  eoding  gain  without  bandwidth  expansion.  It 
eombines  a  multilevel/phase  signal  constellation  with  a  trellis  eoding  scheme— usually  a 
convolutional  code.  A  larger  signal  eonstellation  is  used  to  provide  the  needed  eoding 
redundancy  while  keeping  the  same  channel  symbol  rate  (bandwidth)  and  average  power 
as  those  of  an  uneoded  system.  Figure  2.5  shows  two  multilevel/phase  signal 
constellations  used  by  TCM,  illustrated  along  with  the  corresponding  uncoded  system. 


Uncoded  4-ary  PSK 


Uncoded  4-ary  PAM 


Rate  2/3  coded  8-ary  PSK  Rate  2/3  coded  8-ary  PAM 


Figure  2.5  Increase  of  signal  set  size  for  trellis-coded  modulation 


The  expanded  signal  set  does  result  in  reduced  distance  between  adjaeent  signal 
points  for  a  given  signal  power.  However,  because  of  the  redundancy  introduced  by  the 
code,  this  reduced  distance  no  longer  determines  the  error  performanee.  Instead,  the 
minimum  Euelidean  distanee  (ED)  between  all  pairs  of  eode  sequenees  {a„}  and  {an}. 
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which  the  encoder  can  produce  determines  the  error  performance.  It  is  defined  in 
Equation  (2.2.1). 


=min, 


Yjd^(an,an) 


1/2 


(2.3) 


where  d{a^,a„)  denotes  the  ED  between  channel  signals  a„and  a  « . 

If  soft-decision  ME  decoding  is  used,  the  error-event  probability  will 
asymptotically  approach  the  lower  bound  [19]  at  high  signal-to-noise  ratio. 
¥x{e)>N{d^JQ{d^J2cT„)  (2.4) 


where  N{d^^^ )  denotes  the  average  number  of  error  events  with  distance  d^^^  ,  and  Q(-) 
is  the  Gaussian  error  probability  function,  is  the  variance  of  the  channel  noise. 

Therefore,  assigning  signal  points  to  the  coded  bits  (or  the  state  transitions  in  a 
trellis  codes)  in  a  way  that  maximizes  the  minimum  ED  is  the  key  to  improve  system 
performance.  Ungerbock  [12]  devised  an  assignment  procedure  called  “mapping  by  set 
partitioning”,  which  can  always  make  the  maximum  miminum  ED  larger  than  the 
minimum  distance  between  signal  points  in  an  uncoded  system  with  the  same  data  rate 
and  average  power;  i.e.,  it  can  always  get  coding  gain.  The  coding  gain  can  be  calculated 
as  [32] 


G  = 


(4n  / 


av  '  coded 


AJSJ, 


av  'uncoded 


(2.5) 


where  5*^^  is  the  average  signal  power. 

“Mapping  by  set  partitioning”  first  successively  partitions  a  channel  signal 
constellation  into  subsets  with  increasing  minimum  distance  between  symbols  in  the 
subsets  (see  Eigure  2.6),  and  then  maps  the  signal  constellation  to  code  bits  according  to 
the  following  rules:  All  channel  symbols  are  assigned  with  equal  frequency  and 
symmetry. 


1 .  All  parallel  transitions  in  the  trellis  structure  are  assigned  the  maximum  possible  ED. 

2.  All  transitions  diverging  from  or  merging  into  a  trellis  state  are  assigned  the  next 
maximum  possible  ED  separation. 
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Applying  the  symbol  assignment  rules  to  an  8-state  trellis  as  shown  in  Figure  2.7, 
gives  =  2-141 .  Taking  uneoded  4-PSK  as  reference,  {d^Xncoded  =  1-414.  Here, 

the  coding  gain  for  2/3  rate  coded  8-PSK  is  3.6  dB. 


Figure  2.6  A  partition  of  an  8-PSK  signal  constellation  into  subsets 


dmin=  yjdisf  +  diS^  +  dlS^  =2.141 


Figure  2.7  Symbol  assignment  for  8-PSK  modulation 


2.3.2  CTCM  with  Permuted  State  Structure 

CTCM  with  permuted  state  structure  [9]  [10]  [11]  was  investigated  recently  for 
power-limited  spread  spectrum  channels.  The  goal  is  to  achieve  coding  gain,  processing 
gain  [1],  and  power  efficiency  at  the  same  time.  Orthogonal  and  bi-orthogonal  signal 
constellations  were  researched,  but  they  are  not  optimal  for  power  limited  channels.  A 
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simplex  signal  set  aehieves  the  same  error  probability  as  an  equally  likely  orthogonal  set 
while  using  the  minimum  energy.  It  is  the  optimum  signal  set  to  aehieve  power  effieieney 
[1]  [33].  A  simplex  is  a  set  of  M  signals  in  an  A-dimensional  spaee  with  N>  M-\, 
satisfying  that  for  all  i,j  e  {1,2,...,M},  the  eross-eorrelation  between  signals  and  Sj  is 
{  1, 


S:  •  S: 


-1 

M-1’ 


(2.6) 


for  normalized  signal  energy.  It  ean  be  verified  that  these  M  signals  have  equal  distanee 
from  eaeh  other. 

CTCM  using  simplex  signaling  was  explored  for  very  small  trellises  [14].  But  the 
way  to  build  the  signal  eonstellation  and  the  symbol  assignment  are  not  systematie  yet. 
As  a  result,  the  distanee  property  of  these  eodes  eannot  be  analyzed  systematieally. 
Effieient  deeoding  was  not  investigated  for  these  eodes  before.  Those  are  the  problems 
that  will  be  solved  in  this  dissertation  researeh. 


2,4  Decoding  ofTCM 

There  are  several  effieient  deeoding  algorithms  developed  for  eonventional  TCM, 
sueh  as  sequential  deeoding  proposed  by  Wozeneraft  [18]  in  1961,  threshold  deeoding 
introdueed  by  Massey  [17]  in  1963,  Viterbi  deeoding  proposed  by  Viterbi  [15]  in  1967 
and  BCJR  algorithm  propose  by  L.  R.  Bahl  et  al.  in  1974  [21].  Among  them,  the  most 
frequently  used  in  praetiee  is  Viterbi  algorithm,  whieh  has  been  proved  to  be  a  dynamie 
ML  deeoding  algorithm.  It  is  optimal  in  the  sense  that  it  minimizes  the  probability  of 
eode  word  error.  Another  optimal  one  is  BCJR  algorithm,  whieh  minimize  the  probability 
of  symbol  (or  bit)  error.  These  two  algorithms  are  diseussed  below. 

2,4,1  Viterbi  Algorithm 

For  a  eonventional  {k,r,K)  eonvolutional  eneoder,  denote  the  information 
sequenee  eontaining  L  A: -tuple  information  symbols  as  U  =  .  U. 

belongs  to  the  finite  information  symbol  alphabet.  The  eorresponding  eode  sequenee  is 
denoted  as  F=  (f[, fy,...,fy,...,F^_i^j^).  V.  is  a.  eode  symbol  the  eneoder  ean  output.  In 
eoded  modulation  seheme,  it  is  a  ehannel  symbol  assigned  to  the  state  transition 
oeeurring  at  stage  i.  Suppose  the  sequenee  7?  =  reeeived.  The 
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decoder  produces  an  estimate  V  based  on  the  observation  of  R.  To  minimize  the  code 
word  error,  the  decoder  choose  V  such  that  the  probability  of  Fbeing  sent,  given  the 
received  sequence  R ,  is  maximized  among  all  possible  V ’s,  i.e.,  [1,  see  Appendix  B] 

P(  V  \  R)  =  max  P(V\R)  (2.7) 

all  V 

If  all  V ’s  are  equally  likely  distributed,  (2.3.1)  can  be  replaced  by 

P(R\V)=  max  P(R\V)  (2.8) 

all  V 

This  is  called  maximum  likelihood  (ML)  decoding  criterion.  The  decoder  selects  V 
among  all  possible  L’s  such  that  T’(7?|  V)  is  maximized. 

P(R  I  V)  can  be  computed  from  channel  specification.  In  a  case  of  discrete  memoryless 
channel,  we  have 

L  +  m 

P{R\V)=Y[p{R^\V^)  (2.9) 

./=i 

The  likelihood  function  T’(7?|  V)  is  called  the  path  metric  associated  with  the  path  V . 
P{Rj  I  Vj)  called  the  branch  metric.  For  AWGN  channels  one-sided  noise  power  spectrum 
density  N^, 

\R-V\^ 

P{R\V)  =  -^^e  ,  (2.10) 

where  ||i?  -  vf  is  the  squared  ED  between  R  and  V . 

This  is  equivalent  to  choosing  one  V that  has  the  minimum  ED  to  R . 

Viterbi  algorithm  reduced  the  number  of  comparisons  among  all  the  possible  V’s 
by  removing  those  trellis  paths  that  could  not  possibly  be  considered  for  the  maximum 
likelihood  choices  at  each  trellis  stage.  Only  the  path  with  the  largest  metrics  entering 
each  state  is  stored  at  each  stage.  This  path  is  called  the  survivor.  The  final  survivor  is  the 
decoded  path. 

Eor  TCM  with  a  {k,r,K)  convolutional  encoder,  the  basic  steps  in  Viterbi 
algorithm  are 

1.  Beginning  at  trellis  stage  j  =  K,  compute  the  metric  for  single  path  entering  each  state. 
Store  the  path  and  its  metric  for  each  state. 
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2.  Increase  7  by  1.  For  eaeh  state,  eompute  the  path  metries  for  all  the  paths  entering  a 
state  by  adding  the  braneh  metrie  entering  that  state  to  the  metrie  of  the  eonneeting 
survivor  at  the  preeeding  trellis  stage.  Store  the  path  with  the  largest  metrie  (the 
survivor),  together  with  its  metrie,  and  eliminate  all  other  paths. 

3.  If  7  <  L  +  K ,  repeat  step  2.  Otherwise,  stop. 

2,4,2  BC  JR  algorithm 

The  BCJR  algorithm  is  restated  here  without  derivation.  The  souree  is  assumed  to 
be  a  diserete-time  finite-state  Markov  proeess.  The  S  distinet  states  of  the  Markov  souree 
are  indexed  by  the  integer  m,  m  =  0,1,...,  S'- 1 .  The  state  of  the  souree  at  time  t  is 
denoted  by  S,  and  its  output  by  X, .  A  state  transition  sequenee  extending  from  time  t  to 

t  is  denoted  by  Sl  =  ,  and  the  eorresponding  eode  sequenee  is 

,  where  X,  belongs  to  some  finite  diserete  alphabet.  In  eoded 
modulation  scheme,  it  is  the  ehannel  symbol  assigned  to  state  transition  S, .  The 

Markov  souree  starts  in  the  initial  state  Sq  and  produees  an  output  sequenee  x!^ ,  ending 
in  the  terminal  state  S^ .  Xy  is  the  input  to  a  noisy  DMC  ehannel  whose  output  is  the 
sequenee  Yy  =  1^,}^,...,T^ .  For  all  1  <  t  <  T  , 

p{yI\x[)  =  Y[p{y.\x;)  (2.11) 

j=i 

where  P(Y.  \  X.)  is  the  transition  probability  of  this  DMC. 

The  objeetive  of  BCJR  deeoder  is  to  examine  Yy  and  estimate  the  a  posterior 
probability  (APP)  of  the  states  and  state  transitions  of  the  Markov  souree,  i.e.,  the 
eonditional  probabilities 

P{S,  =  m\Yy^)  =  P{S,  =  m,  Yy^)l  P{Yy^)  (2.12) 

and 

P{S,_y  =  m,S,=m\Yy)  =  P{Sy_y  =  m,S,  =  m,  Yy)  /  P{Yy^)  (2.13) 

In  reality,  BCJR  ealeulates  the  joint  probabilities 

Mm)  =  P(Sy  =  m,Yy^)  (2.14) 

and 
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aXm  ,m)=  P{S,_i  =  m  ,8,  =  m,Y^)  (2.15) 

P{Y^^)is  the  probability  that  =  is  observed.  For  a 

m 

given  Y^  ,P{Y^‘^)  is  a  eonstant.  Dividing  Equations  (2.15)  and  (2.14)  by  this  eonstant 
whieh  is  available  from  the  deeoder  will  always  give  Equations  (2.12)  and  (2.13). 
Alternatively,  we  ean  normalize  A,{m)  and  <jf{m  ,  m)  to  obtain  the  same  result. 

Three  sets  of  probabilities  are  defined  as  follows: 


a^m)  =  P(Si  =  m,Y^)  (2.16) 

/3X>n)  =  P{Y^tAS,  =  >n)  (2.17) 

,m)  =  P{S,  =  m,Y^\S,_^  =  m)  (2.18) 

Then 

X,{m)  =  ai{m)fiXm)  (2.19) 

cr,(m  ,m)=  )yX^  (2.20) 


And  a^(m)  and  y0,(m)ean  be  formed  by  forward  reeursion  in  Equation  (2.21)  and 
baekward  reeursion  in  Equation  (2.22). 

<^((^)  =  X  )^r(^ t  =  (2.21) 

m 

=  )  t  =  E-l,...,0  (2.22) 

m 

y,{m  ,m)  ean  be  obtained  from  Markov  data  souree  and  ehannel  property. 
y^{m  ,m)  =  P{Y^,S^_y  =  m  ^  S^  =  m) 

=  Z/’w  =  m\S,_,  =m)-P{X,  =  X\S,_,  =  m  ,S,  =  m)-P{Y,\X) 

X 

Eromthe/l^or  cr, 

=  )  (2-24) 

w  m,m 

Eor  the  reeursions  in  Equations  (2.21)  and  (2.22)  to  apply  at  t  =  1  and  t  =  L-\ 
respeetively,  a^im)  must  be  the  probability  of  the  eneoder  starting  in  state  m  before 
stage  1  and  Piim)  the  probability  of  the  encoder  ending  in  state  m  after  stage  L.  The 
standard  application  of  the  BCJR  algorithm  assumes  8^=8^  =  0 ,  so 
«o(0)  =  land  ^^(m)  =  0,  for  m  0  (2.25) 
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and 

y9^(0)  =  1  and  Pi{m)  =  0,  for  m  0. 


(2.26) 


The  operations  of  the  deeoder  for  eomputing  and  cr^  are  outlined  below: 

1.  «o(m)  and  are  initialized  aeeording  to  Equations  (2.15)  and  (2.16). 

2.  As  soon  as  is  received,  the  decoder  computes  using  Equation  (2.23)  and 

a^ini)  using  Equation  (2.21)  for  all  t  and  m  . 

3.  After  the  complete  sequence  has  been  received,  the  decoder  recursively  computes 

using  Equation  (2.22).  Then  compute  X^{m)  and  cr/m  ,m)  using  Equation  (2.19) 
and  (2.20). 

After  Equations  (2.14)  and  (2.15)  are  obtained,  the  probability  of  any  event  that  is  a 
function  of  states  or  state  transitions  can  be  obtained  by  summing  the  appropriate  Xj{m) 

or  <j,{m  ,  m).  Then  decode  the  event  as  the  one  having  the  largest  probability. 


2,4,3  Circular  BC  JR  Algorithm 

BCJR  algorithm  is  much  less  popular  than  Viterbi  algorithm  and  is  almost  never 
applied  in  practical  systems.  The  reason  for  this  is  that  it  yields  performance  in  terms  of 
symbol  error  probability  only  slightly  superior  to  the  Viterbi  algorithm,  yet  it  presents  a 
much  higher  complexity.  Both  Viterbi  and  BCJR  algorithm  require  the  starting  state  or 
the  distribution  of  the  starting  state  be  known  a  priori.  This  is  not  the  case  for  circular 
trellis  coding.  The  optimum  ME  decoding  for  circular  trellis  is  to  run  the  Viterbi 
algorithm  the  number  of  total  states  times,  each  for  one  possible  starting  state.  This  is 
obviously  not  desirable  for  large  trellis.  Hence,  BCJR  is  investigated  again  to  be  used  in 
this  case.  Eirst,  the  probability  of  the  distribution  of  starting  state  needs  to  be  solved. 

John  B.  Anderson  [22]  extended  BCJR  algorithm  to  tail  biting  codes.  We  refer  to 
it  as  circular  BCJR  algorithm.  Rewrite  BCJR  in  vector  and  matrix  format.  Define  as  a 
row  vector  and  as  a  column  vector.  Each  of  them  has  S  elements  defined  in  Equations 
(2.16)  and  (2.17),  respectively.  Define  y,  as  an  5*  x  5*  matrix  with  each  element  defined  in 
Equation  (2.18).  Eor  tailing  biting  codes. 
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(2.27) 


then  [22]  shows  that 

0  p(jL^ 


(2.28) 


This  means  is  the  normalized  left  eigenveetor  of  the  matrix  eorresponding  to 

the  largest  eigenvalue.  Similarly,  the  right  eigenveetor  of  Yx-.-Yi  is  the  proper  starting 
veetor  for  (3^  in  most  applieations.  [22]  employs  sueeessive  normalization  to  eontrol  the 
preeision  of  the  ealeulation  without  ehanging  the  results.  This  augment  depends  on  the 
faet  that  sealing  of  any  or  all  of  the  a^,f3i  or  y,  during  reeursions  in  Equations  (2.21)  and 
(2.22)  simply  leads  to  sealed  Z,{m)  and  ,m)  in  Equations  (2.19)  and  (2.20),  but 
Equations  (2.12)  and  (2.13)  ean  always  be  obtained  by  normalizing  and  <j,{m  ,m) 

to  have  unit  sum.  This  eireular  BCJR  is  referred  to  as  eireular  BCJR  with  eigenveetors. 
Using  superseript  "o"  to  indieate  a  unit-sum  veetor,  the  basie  steps  are 
Given 

1.  Eind  the  left  eigenveetor  eorresponding  to  the  largest  eigenvalue  of  Y\—Yl  ■  This  is  a^. 

2.  Caleulate  the  normalized  a’s  by  forward  reeursion 

=  ccUr,  (2.29) 

^  =  h...,E.  (2.30) 


4.  Starting  from  the  right  eigenveetor  of  YvYl  ’  form  the  normalized  P's  by 


(2.31) 

A"=A/ZA(0,  ^  =  E-1,...,0  (2.32) 

i 

4.  Caleulate  the  normalized  X,  and  cr,(m  ,  m)by 

/l/m)  =  a°(m)y0'°(m),  (2.33) 

A°{m)=  (2.34) 

i 

(j,(m  ,m)  =  a°_^(m  )Yt{^  (2.35) 

(j°  =  (j^{m  ,m) ! '^(j,{m  ,m)  t  =  (2.36) 

m  ,  m 
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[22]  also  argues  that  if  we  iterate  the  forward  reeursion  enough  times  and  properly 
normalize  the  outeomes,  then  the  resulting  sequenee  of  outcomes 
a, ... ’^2z,+i  •  •  •  will  converge  to  repetitions  of  ,  where  is  the 

normalized  a  obtained  from  circular  BCJR  with  eigenvectors  .  The  speed  of 
convergence  (the  number  of  iterations  required  by  the  forward  recursion)  is  affected  by 
the  choice  of  initial  .  Similar  argument  holds  for  backward  recursion.  This  gives  rise 
an  iterative  circular  BCJR  as  described  below. 

Given  y!;  =Y„Y^,...,Y, 

1.  Do  not  calculate  the  eigenvectors  of  Yx-.-Yl  •  Set  initial  in  some  way. 

2.  Calculate  a  set  of  normalized  ai  ...al  by  the  recursion  in  Equation  (2.29)  and  (2.30), 
continues  this  recursion  to  find  a° ,  t  =  L  +\,L  +  2,...  .Y ake  Yt ^ 7i  where  I  =  t  mod L . 
When  \a°  -  a°\  is  sufficiently  small  by  a  suitable  measure,  stop.  A  complete  set  of  a 
is  available  in  the  last  L  round. 

3 .  Execute  a  similar  procedure  backward  along  the  trellis  circle,  to  find  the  set  /}[  ...pi. 

Set  initially. 

4.  Same  as  in  circular  BCJR  with  eigenvectors. 

2,5  Spread  Spectrum  and  HDCTCM 

Spread  spectrum  (SS)  communication  system  is  a  system  satisfying  two  criteria 
[34].  Eirst,  the  bandwidth  of  the  transmitted  signal  must  be  much  larger  than  the  message 
bandwidth.  Second,  this  bandwidth  must  be  determined  by  some  function  that  is 
independent  of  the  message,  known  as  PSEUDONOISE  (PN).  The  two  most  prevalent 
types  of  SS  are  direct  sequence  (SS)  and  Erequency  Hopping  (EH).  By  using  PN  to  shift 
the  phase  of  message  in  DS  or  to  select  the  carrier  frequency  in  PH  pseudo  randomly,  the 
effect  of  spreading  the  message  spectrum  over  a  larger  frequency  range  is  achieved.  Both 
systems  can  be  coupled  with  HDCTCM  for  transmission  over  a  power-limited  channel. 
The  coding  gain  and  processing  gain  can  be  achieved  at  the  same  time. 
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CHAPTERS  DESIGN  OF  HDCTCM 


The  design  of  a  trellis-eoded  modulation  involves  the  state  transition  table 
eonstruetion  for  the  eneoder,  the  design  of  the  signal  eonstellation,  and  mapping  rules 
between  the  symbols  in  the  signal  constellation  and  the  state  transitions.  HDCTCM  is 
designed  for  power-limited  spread  spectrum  channels.  The  encoder  employs  the  circular 
trellis  coding  with  permuted  state  structure.  The  state  transition  table  is  built  as  described 
in  Chapter  2.  This  chapter  develops  a  systematic  way  to  design  a  high  dimensional 
simplex  signal  constellation  and  to  do  the  symbol  assignment.  In  Section  3.1,  we  give  the 
design  criterion.  In  Section  3.2,  we  apply  this  criterion  to  HDCTCM  and  build  a  matrix  to 
record  all  sets  of  state  transitions  that  should  be  assigned  simplexes.  In  Section  3.3,  the 
simplex  signal  constellation  and  the  procedure  of  symbol  assignment  are  designed. 

Uniformity  is  a  desirable  property  for  a  coding  scheme  [35].  Analysis  on  error 
performance  of  this  code  will  be  greatly  simplified  under  this  condition.  In  Section  3.4 
we  prove  the  uniformity  of  HDCTCM. 

3,1  Design  Criterion 

The  goal  of  designing  a  coding  scheme  is  to  obtain  coding  gain,  i.e.,  to  get 
reduced  error  probability  compared  with  the  uncoded  system  at  a  specific  signal-to-noise 
ratio.  For  a  trellis  coded  modulation  scheme,  suppose  a  particular  code  sequence  (trellis 
path)  is  transmitted,  then  the  decoder  will  select  one  code  sequence  that  has  the  minimum 
distance  to  the  received  sequence  in  order  to  minimize  the  code  word  error.  Denote  the 
probability  of  making  an  incorrect  decision  on  the  code  sequence  as  Pr(e).  For  AWGN 
channel  with  noise  variance  a;  ,  Pr(e)  will  asymptotically  approach  the  lower  bound  at 
high  signal  to  noise  ratio  [19] 

Pr(e)>A(4J0(4.„/2o-J  (3.1) 
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where  is  defined  as  the  minimum  Euclidean  distance  (ED)  between  all  pairs  of  code 
sequences,  denotes  the  number  of  paths  having  distance  d^^^,  and  Q(-)  is  the 

Gaussian  error  probability  function. 

We  can  see  the  minimum  distance  of  the  code  is  of  primary  importance  to  its  error 
performance.  Usually,  d^-^  will  correspond  to  the  minimum  distance  produced  by  a  path 
that  splits  and  remerges  with  the  transmitted  path,  since  we  would  expect  paths  that  do 
not  remerge  to  keep  accumulating  distance.  This  path  is  called  the  error  event  of  this 
transmitted  path.  And  the  distance  from  this  error  event  to  the  transmitted  path  is  called 
free  distance,  denoted  as  In  order  to  reduce  Pr(e),  we  want  to  maximize  dj^^^  . 

Erom  Equation  (3.1),  we  also  desire  that  the  number  of  code  sequences  having  distance 
dfree  Small.  Thc  symbol  error  probability,  denoted  as  Pr(5)  ,  is  usually  of  more  interest 

than  the  code  word  probability  Pr(e),  and  is  defined  as  the  ratio  of  the  number  of  symbol 
errors  over  the  symbols  in  the  information  sequence.  In  order  to  minimize  the  symbol 
error,  we  also  want  the  information  sequence  corresponding  to  the  decode  path  to  have  a 
small  number  of  symbols  differing  from  the  information  sequence  corresponding  to  the 
transmitted  path.  This  is  to  say,  we  want  the  unmerged  stages  between  the  error  event  and 
the  transmitted  path  as  small  as  possible.  The  error  event  having  the  minimum  unmerged 
stage  with  the  transmitted  sequence  is  called  the  minimum  error  event.  Eor  a  coding 
scheme  with  uniformity,  taking  any  code  sequence  as  the  transmitted  sequence  will  give 
the  same  arguments  as  above. 

3.2  Build  State  Transition  Matrix 

In  this  section,  by  analyzing  the  error  events  in  HDCTM  we  identify  sets  of  state 
transitions  that  should  be  assigned  simplexes.  Then  a  multi-dimensional  matrix  is 
designed  to  record  them.  Eirst,  the  butterfly  structure  of  trellis  codes  is  given  to  facilitate 
the  discussion. 

3,2.1  Butterfly  Structure  in  HDCTCM 

We  denote  HDCTCM  that  employs  a  circular  trellis  T  (n,  D)  with  permuted  state 
structure  as  HDCTCM (n,D).  n  and  D  are  originally  defined  in  Section  2.2.  Eor 
HDCTCM,  n  is  the  size  of  information  symbol  alphabet  and  D  is  the  trellis  depth.  Some 
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other  related  system  parameters  are  information  sequenee  length  L ,  the  number  of  spaee 
dimensions  Noi the  signal  eonstellation  we  will  build,  and  the  total  states  S  =  n^ . 

For  all  trellis  eodes,  we  ean  always  identify  sets  of  p  originating  states  and  sets  of  q  next 
states  that  have  eomplete  intra-eonneetivity,  but  no  eonneetivity  with  other  state  sets. 
Sueh  strueture  is  ealled  a  (p,q)  butterfly.  The  set  of  the  originating  states  or  the  next 
states  in  a  butterfly  is  named  the  originating  state  set  or  the  next  state  set  of  that  butterfly. 
In  a  butterfly,  eaeh  of  the  p  originating  states  has  transitions  to  each  of  the  q  next  states- 
-the  total  number  of  p-q  transitions  in  a  butterfly.  In  HDCTCM(n,Z)) ,  the  state 
transition  table  built  using  the  method  described  in  Section  2.2  shows  {n,n)  butterflies. 
Since  each  state  can  be  a  member  of  one  and  only  one  butterfly’s  originating  states  set 
and  one  and  only  one  butterfly’s  next  states  set,  there  are  a  total  number  oi  S  !  n  =  ' 

butterflies  representing  all  the  -n^  =  state  transitions  in  the  state  transition  table. 

Example  3.1  Take  HDCTCM(4,3)  as  an  example.  The  state  transition  table  is  shown  in 
Table  3.1.  The  states  are  numbered  by  integer  from  1  to  64.  It  can  be  found  that  any 
member  of  the  set  of  statesjl,  64,  4,  33}  can  transit  to  state  1,  2,  5,  and  34.  Then  the  set 
of  states  (1,  64,  4,  33}  and  the  set  of  states  (1,  2,5,  34}  build  a  butterfly;  they  are  the 
originating  states  set  and  the  next  states  set  of  this  butterfly,  respectively.  We  write  this 
butterfly  as  butterfly  {{1,  64,  4,  33}, {1,  64,  4,  33}  }.  All  16  butterflies  can  be  identified 
and  are  illustrated  in  Figure  3.1,  where  each  box  represents  a  butterfly.  The  originating 
state  set  and  next  state  set  are  in  the  left  side  and  right  side  of  a  butterfly,  respectively.  By 
this  representation,  we  regard  a  butterfly  as  an  ordered  structure  and  refer  a  particular 
arrangement  of  the  states  in  a  butterfly  as  the  internal  order  of  a  butterfly.  The  location  of 
the  state  (or  transition)  in  a  butterfly  is  referred  to  as  the  internal  location  of  the  state  (or 
transition).  The  internal  location  of  an  originating  state  or  a  next  state  from  top  to  bottom 
in  a  butterfly  is  1,2,  3,  and  4.  Number  the  butterflies  arbitrarily  by  integer  from  1  to  16. 
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State 


Table  3.1  State  Transition  Table  for  HDCTCM  (4,3) 


State 

Input  0 

Input  I 

Input  2 

Input  3 

33 

34 

5 

2 

I 

34 

35 

18 

51 

40 

35 

36 

33 

39 

46 

36 

37 

15 

8 

3 

37 

38 

56 

21 

58 

38 

39 

46 

36 

33 

39 

40 

51 

18 

35 

40 

41 

45 

59 

60 

41 

42 

57 

49 

19 

42 

43 

30 

54 

16 

43 

44 

23 

48 

32 

44 

45 

41 

60 

59 

45 

46 

39 

33 

36 

46 

47 

II 

26 

6 

47 

48 

32 

44 

23 

48 

49 

19 

42 

57 

49 

50 

10 

14 

4 

50 

51 

40 

35 

18 

51 

52 

24 

22 

61 

52 

53 

55 

13 

27 

53 

54 

16 

43 

30 

54 

55 

53 

27 

13 

55 

56 

38 

58 

21 

56 

57 

42 

19 

49 

57 

58 

21 

56 

38 

58 

59 

60 

41 

45 

59 

60 

59 

45 

41 

60 

61 

22 

24 

52 

61 

62 

31 

63 

12 

62 

63 

12 

62 

31 

63 

64 

7 

25 

17 

64 

2 

I 

34 

5 

5 


6 


25^ 

^26 

46^ 

0  47 

10^ 

O  11 
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Figure  3.1  Butterflies  in  HDCTCM  (4,3) 


3.2,2  Minimum  Error  Events  and  Simplex-Transitions 

Let  us  consider  the  error  events.  As  shown  in  Section  2.2,  for  a  circular  trellis 
T(n,Z))  with  permuted  state  structure,  the  smallest  information  sequence  length  that  can 
be  employed  is  L  =  D  +  l.  The  minimum  error  events  occur  in  this  situation.  There  are  a 
total  number  of  paths  in  the  trellis.  Each  starting  state  associates  with  n  paths 
diverging  at  the  beginning  and  remerging  at  stage  D  +  l  (see  Figure  3.2).  Given  that  each 
state  transition  occurs  equally  likely  and  there  is  no  better  knowledge  to  differentiate 
these  n  paths  from  each  other,  we  will  make  these  n  paths  equally  distant  from  each 
other  in  our  design.  Take  one  of  them  as  the  transmitted  path;  the  minimum  error  events 
are  the  other  n-  \  paths.  In  order  to  make  as  large  as  possible  and  achieve  energy 

efficiency  in  power-limited  channel,  at  each  trellis  stage  the  n  state  transitions  on  these  n 
paths  should  be  assigned  a  simplex.  We  name  the  set  of  such  n  state  transitions  as  a 
simplex-transition.  A  simplex-transition  at  stage  i  is  denoted  as  simplex-transitioni, 
i  =\,2,...,D  +  \  (see  Figure  3.2). 
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stage  1  2 


1 


D  D+1 


simplex-transitiotii 


Figure  3.2  The  n  paths  associated  with  a  certain  starting  state  for  HDCTCM(n,Z))  with 

L  =  D  +  l 


For  each  stage  i,  the  n  paths  associated  with  a  certain  starting  state  define  a 
simplex-transitioni;  then,  for  all  the  possible  starting  states,  there  is  a  total  number  of 
simplex-transitioni;  for  each  i,  i  =\,2,...,D +  \.  A  particular  state  transition  appears 
exactly  once  in  a  simplex-transitioni;  for  all  i,  i  =  \,2,...,D  +  \. 

The  set  of  originating  states  or  next  states  of  the  n  transitions  in  a  simplex- 
transition  is  called  the  originating  state  set  or  next  state  set  of  this  simplex-transition. 

Example  3.2  For  HDCTCM(4,3),  Appendix  A  gives  all  the  paths  at  L  =  D  +  l  =  4 .  The 
set  of  4  state  transitions  at  stage  i  on  the  paths  associated  with  a  starting  state  constitute  a 
simplex-transitioni;  for  each  i,  i  =1,2,3, 4.  There  are  64  simplex-transitioni ’s;  for  each  i, 
/=  1,2,3, 4. 

For  instance,  on  the  4  paths  associated  with  starting  state  3,  the  set  of  state 
transitions  at  stage  2  constitute  a  simplex-transition2  denoted  as  simplex- 
transition2{4  ^1,  14  ^3,  10^  6,  50^  35}  •  For  a  particular  state  transition— say 
2^3  —it  can  be  verified  that  it  appears  exactly  once  in 
one  simplex-transitioni  (2^3,  2^8,  2^15,  2^37}, 
one  simplex-transition2{l  ^1,  2  ^  3,  5  ^  6,  34  ^  35} , 
one  simplex-transitions  {26^  13,  18^49,2^3,  8^9},  and 
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one  simplex-transition4{2  ^3,  14^3,  7^3,36^3}- 


3,2.3  Illustrate  Simplex-Transitions  in  Butterfly  Structure 

In  HDCTCM(n,Z)) ,  all  distinct  state  transitions  are  represented  in  its  ' 
butterflies.  So,  we  can  analyze  how  the  simplex-transitions  are  reflected  in  the  butterflies. 
From  Figure  3.2  we  can  see  that  the  n  transitions  in  a  simplex-transitioni  have  a  same 
originating  state,  so  they  are  contained  in  the  butterfly  whose  originating  state  set 
contains  this  originating  state.  They  are  the  state  transitions  from  this  originating  state  in 
this  butterfly  to  each  of  all  the  next  states  in  this  butterfly.  The  n  transitions  in  a  simplex- 
transitionD+i  have  a  same  next  state  and  are,  therefore,  contained  in  the  butterfly  whose 
next  state  set  contains  this  next  state.  They  are  the  state  transitions  from  each  of  all  the 
originating  states  to  this  next  state  in  this  butterfly.  Each  butterfly  contains  n  simplex- 
transitioni ’s  and  n  simplex -transitionD+i’s.  A  total  number  of  '  butterflies  contain  all 
the  simplex-transitioni ’s  and  simplex-transitionD+i’s.  For  the  n  transitions  in  a 

simplex-transitioni,  2<i  <  D,  each  transition  has  a  different  originating  state  and  a 
different  next  state.  Compared  with  the  butterflies,  it  can  be  seen  that  each  transition  is 
contained  in  a  different  butterfly.  We  say  there  are  n  butterflies  associated  with  a 
simplex-transitioni. 

Example  3,3  For  HDCTCM  (4,3),  compare  all  the  simplex-transitioni ’s  from  Appendix 
A  with  all  its  16  butterflies  in  Figure  3.1.  For  instance,  on  the  4  paths  associated  with 
starting  state  3,  the  simplex-transitioni  {3  ^  4^  3  ^  14^  3  ^  10,  3  ^  50},  is  contained  in 
butterfly  3,  as  shown  in  Figure  3.3  (a).  The  simplex- 

transition4{2^  3,  14^3,  7^3,36^3}  is  contained  in  butterfly  2,  as  shown  in 
Figure  3.3  (b).  The  4  transitions  in  simplex- 

transition2{4  ^1,  14^3,  10^6,  50  ^35}  are  contained  in  butterfly  1,  2,  4,  and  10, 
respectively  as  shown  in  Figure  3.3  (c).  It  can  be  verified  that  the  other  15  transitions  in 
each  of  the  butterfly  1,  2,  4,  and  10  constitute  the  other  15  simplex-transition2’s. 
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Figure  3.3  Illustrate  simplex-transitions  in  butterflies  for  HDCTCM(4,3) 


In  fact,  for  HDCTCM(n,Z))  ,  the  following  property  is  observed  for  a  simplex-transitioni, 
2<i<D. 

Property  3.1  Consider  two  simplex-transitioni’s:  if  the  originating  state  (or  next  state)  of 
a  transition  in  one  simplex-transitioni  is  the  same  as  the  originating  state  (or  next  state)  of 
a  transition  in  the  other  simplex-transitioni,  then  the  originating  state  set  (or  next  state  set) 
of  one  simplex-transitioni  will  be  identieal  to  that  of  the  other  simplex-transitioni. 

From  this  property,  we  have  the  following  statement. 

Statement  3.1  For  a  simplex-transitioni,  find  the  n  butterflies  assoeiated  with  it.  Then 
the  other  -1  transitions  in  eaeh  of  these  n  butterflies  eonstitute  the  other  -1 
simplex-transitioni  ’  s . 

Proof:  Number  these  n  butterflies  assoeiated  with  the  first  simplex-transitioni  as  butterfly 
m,  m  =  \,2,...,n .  The  originating  states  and  next  states  in  butterfly  m  will  be  labeled 
using  and  r^j,  j  =  1,2,.. .,«  as  our  proof  eontinues. 

Eaeh  of  the  n  transitions  in  a  simplex-transitioni  is  eontained  in  a  different  butterfly.  So, 
for  the  first  simplex-transitioni,  we  ean  label  the  originating  state  and  next  state  of  the 
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transition  contained  in  butterfly  m  as  and  and  then  this  first  simplex-transitioni  is 
{gmi  =  1, •••,«}  (see  Figure  3.4  (a)). 


g43 

g41 

g44 

g42 


Ui 

T44 

Ui 

U2 
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Figure  3.4  Simplex-transitioUi’s  in  the  four  associated  butterflies 


Consider  the  other  transitions  in  these  n  butterflies.  For  a  particular  butterfly  m  , 
m  =  there  are  other  n-\  transitions  having  as  next  state.  Label  them  as 

k  =  2,3,...,n  (see  Figure  3.4  (b)).  For  each  k,  consider  a  new  simplex- 
transition  containing  transition  g  r  ■ , .  The  next  state  of  transition  g  ,  ^  r  ,  is  r  . 

j  is  also  the  next  state  of  the  transition  g^j  in  the  first  simplex-transitioni.  From 

Property  3.1,  the  next  state  set  of  this  new  simplex-transitioni  will  be  identieal  to  that  of 
the  first  simplex-transitioni;  it  is  the  set  of  states  This  indieates  that  this 

new  simplex-transitioni  is  eontained  in  these  n  butterflies.  For  this  new  simplex- 
transitioni,  we  ean  label  the  transition  eontained  in  butterfly  m ,  m  ,  as  g^^  . 

Then  this  new  simplex-transitioni  is  {g^^  ^  =  1,. . . 
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Similarly,  there  are  other  n-\  transitions  originating  from  ^  in  butterfly  m  . 
Label  them  as  ^  ^  “  2,3, ...,n  (see  Figure  3.4  (e)).  For  eaeh  k ,  a  new  simplex- 

transition  eontaining  the  transition  g^  ^  have  the  originating  state  set  identieal 

to  that  of  the  first  simplex-transitioni.  It  is  the  set  of  states  {g^Jm  =  l,...,n}.  This 
indieates  that  this  new  simplex-transitioni  is  also  eontained  in  these  n  butterflies.  For  this 
new  simplex-transitioni,  we  ean  label  the  transition  eontained  in  butterfly  m  ,  m  ^  m  ,  as 
Smi  f'mk-  Then  this  new  simplex-transitioni  is  {g^j  =  1,- 

So  far,  {n  -  l)  +  {n-l)=  2n  -  2  more  transitions  in  eaeh  of  these  n  butterflies 
have  been  eonsidered  and  they  eonstitute  2n-2  new  simplex-transitioni’s.  All  the 
originating  and  next  states  in  these  n  butterflies  have  been  labeled  as  g^j  and  r^j, 

j  =  \,2,...,n. 

The  transitions  yet  to  be  eonsidered  in  butterfly  are  g  r  .  ,  where 

s,t  =  2,3,... ,n .  For  eaeh  s  and  t,  eonsider  a  new  simplex-transitioni  eontaining  the 
transition  From  Property  3.1,  it  will  have  the  originating  state  set  identieal  to 

that  of  the  simplex-transitioni  {g^^  ^  =l,...,n }.  It  is  the  set  of  states 

jg^Jm  =  Also,  it  will  have  the  next  state  set  identieal  to  that  of  the  simplex- 

transitioni  {g^j  It  is  the  set  of  states  This  shows  that 

the  new  simplex-transitioni  is  {g„^  r^\m  =  \,...,n}.  So,  we  have  shown  the  remaining 
{n  -  -  {n  -  \)  =  n  -2n+\  uneonsidered  transitions  in  eaeh  butterfly  also  eonstitute  the 

other  {n  -  \)  -{n-l)  =  -2n+\  new  simplex-transitioni’s.  So  far,  we  have  shown  that 

set  of  transitions  ^  1, •••,«}  is  a  simplex-transitioni;  for  all  j  and  k, 

j,  k  =  l,2,...,n. 

In  summary,  we  have  proved  that  in  the  n  butterflies  assoeiated  with  a  simplex- 
transitioni,  all  the  n-{n-n)  transitions  will  eonstitute  a  number  of  n-n  simplex- 
transitioni’s.  Later  in  this  dissertation,  we  may  say  these  n  butterflies  eonstitute  simplex- 
transitioni.  Also,  we  name  a  set  of  n  butterflies  eonstituting  simplex-transitioni  as  a 
simplex-transitioni-butterfly-set. 
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For  each  i,  2<i<D,  there  are  number  of  simplex -transitioni’s.  The  total 

number  of  '  butterflies  can  be  grouped  into  sets  of  n  butterflies  constituting 
simplex-transition,  each  set  containing  simplex-transitioni’s.  Any  particular  butterfly 
is  a  member  of  a  set  of  n  butterflies  constituting  simplex-transitioni  for  all  i,  2<i  <  D. 

Example  3.4  For  HDCTCM  (4,3),  all  the  butterflies  and  simplex-transitions  are  solved 
in  Examples  3.1  and  3.2.  We  can  identify  the  4  simplex-transition2-butterfly-sets.  They 
are:  butterfly {1,  2,  4,  10},  butterfly {3,  6,  9,  12},  butterfly {5,  8,  7,  14},  and 
butterfly  {15,  11,  13,  16};  The  4  simplex-transitions-butterfly-sets  are 
butterfly (1,  3,  5,  15},  butterfly (2,  6,  8,  11},  butterfly (4,  9,  7,  13},  and 
butterfly  (10,  12,  14,  16}. 

Note  that  the  butterflies  and  all  the  paths  at  L  =  D  +  \  are  completely  determined 
by  the  state  transition  table,  so  all  sets  of  n  transitions  constituting  simplex-transitioni’s 
where  i  =  \,2,...,D  +  \  and  all  sets  of  n  butterflies  constituting  simplex-transitioni’s 
where  i  =  2,3,...,D  are  fixed  in  HDCTCM  for  a  given  n  and  D . 

3,2.4  Arrange  the  Internal  Orders  of  Butterflies  in  a  Simplex-Transitioni-Butterfly- 
Set 

In  the  next  two  sections,  we  will  build  a  convenient  structure  to  record  all  the 
simplex-transitions  (butterflies).  The  proof  of  Statement  3.1  has  shown  that  in  a  simplex- 
transitioni-butterfly-set,  by  proper  labeling  the  set  of  transitions  {g^j  r^i\m=l,...,n} 
constitute  a  simplex-transitioui  for  all  j  and  k,  j,  k  =  \,2,...,n .  Since  we  have 
represented  a  butterfly  as  an  ordered  structure,  if  we  place  .  in  butterflies  m  the  same 

internal  location  as  g^-.  in  butterfly  m  ,  m  ,  m  =  1,2,  ...,n,  then  the  set  of  n  transitions 

constituting  a  simplex-transitioni  will  be  in  the  same  internal  location  of  these  n 
butterflies.  The  steps  to  do  this  are  described  below  in  Procedure  3.1. 

Procedure  3,1  Arrange  the  Internal  Orders  of  butterflies  in  a  simplex-transitioni. 
butterfly-set,  i  =2,3,...,D . 
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Number  these  n  butterflies  as  butterfly  m  ,  m  =  \,2,...,n  .  The  originating  states  and  next 
states  in  butterfly  m  will  be  labeled  using  g^j  and  r^. ,  j  =  1,2, 

1 .  Seleet  any  one  of  these  n  butterflies,  say  butterfly  m  .  Arrange  the  originating  states 
and  next  states  in  the  left  side  and  right  side  in  this  butterfly  arbitrarily.  Label  them  as 

and  r^.  arbitrarily,  j  = 

2.  For  eaeh  k,  k  =  \,2,...,n,  identify  the  simplex-transitioni  eontaining  transition 

g  ,  For  this  simplex-transitioni,  we  ean  label  the  transition  eontained  in 

butterfly  m,  m^m,  as  Plaee  and  in  butterfly  m  in  the  same 

internal  loeation  as  g^,  and  ^  in  butterfly  m  . 

3.  For  eaeh  k,  k  =  2,3,...,n,  identify  the  simplex-transitioni  eontaining  transition 

Sm'i  partieular  simplex-transitioni,  we  ean  label  the  transition  in  this 

simplex-transition  eontained  in  butterfly  m ,  m^m  ,  as  g^y^r^k-  Plaee  in 
butterfly  m  in  the  same  internal  loeation  as  ^  in  butterfly  m  . 

Following  the  proof  of  Statement  3.1,  it  ean  be  verified  that  all  the  other  set  of  n 
transitions  {g„^  ,  for  all  5  and  t,  s,  t  =  2,3,...,n  eonstitute  simplex- 

transitioni,  and  are  in  the  same  internal  loeation  of  these  n  butterflies. 

From  this  proeedure,  we  ean  see  one  of  the  n  butterflies’  internal  orders  will  fix 
all  the  other  n  butterflies’  internal  orders  in  a  simplex-transitioni-butterfiy-set. 


Example  3,5  For  HDCTCM  (4,3),  from  Example  3.4,  we  know  butterfly {1,  2,  4,  10}  is 
a  simplex-transition2-butterfly-set.  We  will  arrange  the  internal  order  of  them  aeeording 
to  Proeedure  3.1. 


1 .  First  ehoose  any  one  of  these  four  butterflies— say  butterfly  2— and  arrange  the  states  in 


an  arbitrary  way  (see  Figure  3.5  (a)). 
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Figure  3.5  Arrange  the  internal  orders  of  the  butterflies  in  a  simplex-transition2-butterfly- 

set  for  HDCTM(4,3) 


2.  For  each  of  the  transitions  7^3,  2^3,  14  ^3  and  36  ^3,  identify  the  simplex- 
transtition2  containing  this  transition  from  Appendix  A;  they  are 
simplex-transition2{7  ^3,  64  ^  1,  25  ^  6,  17  ^  35} , 

simplex-transition2{2  ^3,  1  ^  1,  5  ^  6,  34  ^  35}, 
simplex-transition2{14^  3,  4^1,  10^6,  50^35}  and 
simplex-transition2{36^  3,  33  ^1,  46^  6,  39^  35}  • 

Then,  the  originating  states  64,  1,  4,  33  and  next  state  1  should  be  placed  in  the 
same  internal  location  in  butterfly  1  as  originating  state  7,  2,  14,  36  and  next  state  3  in 
butterfly  2.  Similarly,  the  locations  of  the  originating  states  and  one  next  state  of 
butterflies  4  and  10  will  be  fixed  (see  Figure  3.5  (b)). 

3.  For  each  of  the  transitions  7^15,  7^37  and  7^8,  the  simplex-transition2 
containing  this  transition  is 

simplex-transition2{7  ^15,  64  ^  5,  25  ^  1 1,  17^51}, 
simplex-transition2{7  ^  37,  64  ^  34,  25  ^  47,  17  ^  40}  and 
simplex-transition2{7  ^8,  64  ^  2,  25  ^  26,  17^18}- 

Then,  in  butterfly  1,  the  next  state  5,  34,  2  should  be  placed  in  the  same  internal 
location  as  the  next  state  15,  37,  8  in  butterfly  2.  Similarly,  the  locations  of  the  three  other 
next  states  of  butterfly  4  and  10  will  be  fixed  (see  Figure  3.5  (c)). 


3.2,5  Build  State  Transition  Matrix 

We  have  seen  that  for  HDCTCM(n,Z)) ,  a  total  number  of  '  butterflies  exist. 
Simplex-transitioni  and  simplex-transitionD+i  are  within  a  butterfly.  Simplex-transitioui, 
where  2<i  <  D  are  constituted  by  sets  of  n  butterflies.  We  will  regard  a  butterfly  as  a 
unit  element  with  ordered  structure,  and  place  all  the  butterflies  in  a  Z)  - 1  dimensional 
matrix  with  n  location  indexes  along  each  matrix  dimension.  Name  this  matrix  as  state 
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transition  matrix  (STM).  A  location  in  STM  is  referred  to  using 

STM(xi,X2, where  is  the  loeation  index  along  the  dimension  of 
STM,  e {1,2,. A:  =  1,2, .  When  x^.  =: ,  it  means  ean  take  any  possible 
value.  STM(Xj,X2, ...,x^_j,:,x^^j,...,X23_i)  will  represent  the  n  loeations  along  the 
dimension.  These  n  loeations  have  the  same  loeation  index  x.  along  the  7);,  dimension, 
where  j  .  When  x^.  -Jm  ,  where  m  e{l,2,...,n}  ,  it  means  x^  ean  take  any  possible 
value  exeept  m . 

Sinee  any  partieular  butterfly  is  a  member  of  a  set  of  n  butterflies  eonstituting 
simplex-transitioui,  for  all  i,  2<i  <  D.  We  will  design  a  way  to  plaee  all  the  butterflies 
into  STM  sueh  that  the  set  of  n  butterflies  constituting  simplex-transitioni  are  plaeed  in 
the  n  loeations  along  the  (i-l),/,  dimension  of  STM,  i.e.,  STM 

(Xj,X2,...,x,_25:a,vA£)-i)5  for  all  i,  2  <i  <  D .  There  are  ^  possible  eombinations  for 

Xj,  7  ^  z  - 1 .  A  total  number  of  sets  of  n  loeations  along  the  (z  - dimension  are 

used  for  plaeing  all  the  zz^^^  sets  of  zz  butterflies  eonstituting  simplex-transitioni  for  all  z, 
2<i  <  D.  Also,  the  internal  orders  of  the  set  of  zz  butterflies  eonstituting  simplex- 
transitioni,  where  2  <  z  <  D,  ean  be  arranged  aceording  to  Proeedure  3.1  sueh  that  the  zz 
transitions  eonstituting  a  simplex-transitioni  are  plaeed  in  the  same  internal  loeation  of 
these  zz  butterflies.  Then  finally,  in  STM,  a  simplex-transitioni,  2<i  <  D,  will  be  the  zz 
transitions  loeated  in  the  same  internal  loeations  of  a  set  of  zz  butterflies  along  the  (z  - 1),^ 
dimension. 

Note  that  Proeedure  3.1  only  arranges  the  internal  orders  of  the  set  of  zz  butterflies 
eonstituting  simplex-transitioni.  When  plaeing  these  zz  butterflies  in 
STM(xj,X2,  ...,x,_2,:a,vA£.-i),  the  order  of  plaeing  these  zz  butterflies  in  these  loeations 
is  not  fixed  in  Proeedure  3.1.  We  will  see  shortly  in  the  proeedure  of  building  STM  that 
the  first  set  of  zz  butterflies  eonstituting  simplex-transitioni  ean  be  plaeed  into 
STM(xj,X2,  ...,x,._2,:a,vAz)-i)  in  an  arbitrary  order,  but  a  partieular  ehoiee  on  this  order 
will  fix  the  order  of  plaeing  all  the  other  sets  of  zz  butterflies  eonstituting  simplex- 
transitioni  along  the  (z  - 1),^  dimension  of  STM.  We  will  define  a  ehoiee  set  ealled  STM- 
FREE,  whose  member  elements  indieate  a  partieular  ehoiee  made  for  arranging  the 
internal  orders  or  the  order  of  plaeing  the  zz  butterflies  eonstituting  simplex-transitioni 
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along  the  (/-!)„,  dimension  when  building  STM.  The  proeedure  of  building  STM  is 

stated  as  below. 

Procedure  3,2  Build  STM 

For  HDCTCM(n,Z)) ,  number  its  butterflies  from  1  to  '. 

1.  First,  seleet  any  butterfly,  reeord  this  ehoiee  as  STM-FREE  (first  butterfly).  There  are 

'ehoiees.  Take  n=4,  Z)=4  as  an  example.  For  instanee,  butterfly  1  is  ehosen. 
Seeondly,  plaee  this  seleeted  butterfly  into  any  loeation  in  STM,  say— 
STM(/j,/2,...,/o_j)  .  Reeord  a  partieular  ehoiee  in  STM-FREE  (first  loeation).  There 
are  'ehoiees  (see  Figure  3.6  (a),  take  1^=2,  4=3  and  4  =  1)-  Then  plaee  the  n 
originating  states  in  the  left  side  of  this  butterfly  in  an  arbitrary  way  and  reeord  a 
partieular  arrangement  in  STM-FREE  (left  side  butterfly).  There  are  n !  different 
arrangements  (see  Figure  3.6  (b)).  Finally,  plaee  the  n  next  states  in  the  right  side  of 
this  butterfly  in  an  arbitrary  way  and  reeord  a  partieular  arrangement  in  STM-FREE 
(right  side  butterfly).  There  are  n  !  different  arrangements  (see  Figure  3.6  (e)).  STM- 
FREE  (left  side  butterfly,  right  side  butterfly)  eompletely  fixes  the  internal  order  of 
this  butterfly.  Name  this  first  seleeted  butterfly  as  the  anehor  butterfly. 

2.  Build  the  first  dimension.  Identify  the  other  n-\  butterflies  that  eonstitute  simplex- 
transition2  with  the  anehor  butterfly.  The  internal  orders  of  these  n-\  butterflies  are 
fixed  with  respeet  to  the  anehor  butterfly  using  Proeedure  3.1.  They  should  be  plaeed 
into  loeations  along  the  first  dimension  of  STM  and  should  have  the  loeation  indexes 
along  all  the  other  dimensions  the  same  as  anehor  butterfly,  i.e.,  the  loeations 
STM(xi,4vJ£.-i)  where  Xj  =://;.  The  order  of  plaeing  them  is  arbitrary.  There  are 
(n-1)!  different  ways.  Reeord  a  partieular  arrangement  in  STM-FREE  (fit  dimension). 
See  Figure  3.6  (d),  assuming  that  butterfly {1,  2,  3,  4}  eonstitute  simplex-transitioni. 

3 .  Build  the  seeond  dimension.  Identify  the  other  n  -  \  butterflies  that  eonstitute  simplex- 
transitions  with  the  anehor  butterfly.  The  internal  orders  of  these  n-\  butterflies  are 
fixed  with  respeet  to  the  anehor  butterfly  using  Proeedure  3.1.  They  should  be  plaeed 
into  loeations  along  the  2nd  dimension  of  STM  and  have  the  same  loeation  indexes 
along  all  the  other  dimensions  as  the  anehor  butterfly,  i.e.,  the  loeations 
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(j)  (k)  (1) 

Figure  3.6  Build  STM  for  HDCTCM(4, 4) 


STM(/j,X2,/3,.--,/z)_i)  where  Xj  =:/4-  The  order  of  plaeing  them  is  arbitrary.  There  are 
(n-1)!  different  ways  to  plaee  them.  Reeord  a  partieular  arrangement  in  STM -FREE 


42 


(2nd  dimension).  See  Figure  3.6  (e),  assuming  that  butterfly{5,  1,  6,  7}  constitute 
simplex-transitions.  For  each  Xj  where  regard  the  butterfly  in 

STM(/j,X2,/3,.--,/o_i)  as  the  anchor  butterfly.  Repeat  step  2  and  the  other  n-\ 
butterflies  constituting  simplex-transitions  with  this  butterfly  will  be  identifled.  Their 
internal  order  is  fixed  with  respect  to  this  butterfly  using  Procedure  3.1  and  they 
should  be  placed  in  locations  along  the  first  dimension — STM(Xj,X2,/3,.--,/£i_i)  where 
Xj  =://,.  Denoted  these  n-\  butterflies  as  b^.  A:  =  1,2,3.  This  time,  the  order  of 
placing  them  is  now  fixed.  Suppose  butterfly  is  to  be  placed  in 
STM(7,X2,/3,...,/2)_i)  where  y  e{l,2,...,n}  and  y  /j ;  that  means  is  a  member  of  the 
simplex-transitions-butterfly-set  containing  the  butterfly  in  STM(y,X2,/3,...,/£,_i) 
which  has  been  placed  in  the  previous  stage.  Since  a  particular  butterfly  is  a  member 
of  one  and  only  one  simplex-transitions-butterfly-set,  so  by  cross-checking  the 
membership  of  butterfly  b^.  in  the  n-\  simplex-transitions-butterfly-sets  containing 
butterflies  in  STM(Xj, 4, 4, where  Xj  the  location  index  of  butterfly 
along  the  first  dimension  is  obtained  (see  Figure  3.6  (f)).  In  Figure  3.6  (f),  assume  that 
butterfly  8,  9,  and  10  constitute  simplex-transitioni  with  butterfly  5,  and  the  three  of 
simplex-transition3-butterfly-set  containing  butterfly  2,  3,  4  are  butterfly 

{8,  11,  2,  14},  butterfly  {10,  12,  4,  15},  and  butterfly  {9,  13,  3,  16},  respectively. 
Then  butterfly  8,  9  and  10  should  all  have  the  same  location  index  along  the  2nd 
dimension  as  butterfly  5  and  have  the  same  location  index  along  the  1st  dimension  as 
butterflies  2,  4,  3,  respectively.  Similarly,  All  the  rest  of  the  locations  are  filled  with 
the  proper  butterflies.  We  see  the  order  of  placing  the  other  n-\  butterflies  in  the 
simplex-transition2-butterly-set  and  simplex-transition3-butterfly-set  containing  the 
anchor  butterfly  fix  all  the  butterflies’  location  in  this  two-dimensional  place  where  the 
anchor  butterfly  is  located. 

4.  Build  the  third  dimension.  Identify  the  other  n-\  butterflies  constituting  simplex- 
transitiond  as  the  anchor  butterfly;  their  internal  order  will  be  fixed  using  Procedure 
3.1.  They  should  be  placed  in  . .,l ^y)  where  X3  =:/4.  The  order  of 

placing  them  is  arbitrary.  There  are  {n-\)\  different  ways  to  place  them.  Choose  a 
particular  arrangement  and  record  it  in  STM -FREE  (3rd  dimension).  See  Eigure  3.6 
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(g),  (h),  and  (i),  assuming  that  butterflyjl,  17,  18,  19}  constitute  simplex-transition4. 
For  each  X3  where  X3  regard  the  butterfly  in  STM(/j,/2,X3,...,/£,_j)  as  the  anchor 
butterfly.  Repeat  step  2  and  3;  butterflies  from  certain  simplex-transition2-butterfly- 
sets  and  simplex-transitions-butterfly-sets  will  be  identified  and  placed  into  the  rest  of 
locations  in  the  two-dimensional  plane  containing  this  butterfly— 
STM(:,:,X3,/4, and  their  locations  are  also  fixed.  Because  for  each  X3  where 
X3  ^^4,  when  repeating  step  2  and  3,  the  order  of  placing  the  butterflies  constituting 
simplex-transition2  with  the  butterfly  in  along  the  first 

dimension  into  STM(Xj,4,X3,/4,...,4,_j)  where  Xy  -Jly  will  be  fixed  by  cross-checking 
the  memberships  of  these  butterflies  in  the  simplex-transition4-butterfly-sets 
containing  the  butterflies  in  STM(xi,4,454 v,4)-i)  where  Xy-Jly.  The  order  of 
placing  the  butterflies  constituting  simplex-transitions  with  the  butterfly  in 
STM(4,45-^3v,/d_i)  along  the  second  dimension  into  STM(4,X2,X3,/4,...,4)_i), 
where  X2  =:/4  will  be  fixed  by  cross-checking  the  memberships  of  these  butterflies  in 
the  simplex-transition4-butterfly-sets  containing  the  butterflies  in 
STM(4,X2,4,4 v,4)-i)  where  X2  =:/4-  Then,  from  the  previous  steps,  this  will 
consequently  fix  all  other  butterflies  in  this  two-dimensional  plane— 
STM(:,:,X3,4, •.•,/b-i)  Figure  3.6  (j))-  In  Figure  3.6  (j),  assume  that  butterfly  20, 
21,  and  22  constitute  simplex-transition2  with  butterfly  17  and  also  assume  that 
butterfly  23,  24,  and  25  constitute  simplex-transitions  with  butterfly  17.  Then  the 
locations  of  butterfly  20,  21,  22,  23,  24,  and  25  will  be  fixed  by  cross-checking  with 
simplex-transition4-butterfly-sets  containing  butterfly  2,  3,  4  and  5,  6,  7.  Assume 
butterfly  20  is  in  the  simplex-transition4-butterfly-set  containing  butterfly  2,  butterfly 
23  is  in  the  simplex-transition4-butterfly-set  containing  butterfly  5,  then  they  should 
have  the  same  location  indexes  along  first  and  second  dimension  in  STM(:,;,2)  as 
butterfly  2  and  5  in  STM(:,:,1),  respectively.  By  this  way,  proper  sets  of  butterflies 
will  be  placed  in  the  rest  locations  in  STM  (:,:,2).  Similarly,  the  rest  locations  in 
STM(:,:,3)and  STM(:,:,4)  will  be  filled  (see  Figure  3.6  (k)  and  (1)).  The  internal 
order  of  all  these  butterflies  will  be  fixed  using  Procedure  3.1. 
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5.  Continue  this  way,  each  time  fill  the  rest  of  locations  along  a  new  dimension  of  STM, 
until  completely  filling  the  D-l  dimensional  matrix.  At  step  i ,  the  n-\  butterflies 
constituting  simplex-transitioni  with  the  anchor  butterfly  will  be  placed  into  locations 
along  the  (/- 1)^;, dimension,  i.e.,  the  locations  STM(/j,/2,...,x,_j,/,.,...,/£,_i)  where 
=://,_!•  The  order  of  placing  them  in  these  locations  is  arbitrary.  Record  a 
particular  arrangement  in  STM-FREE  ((/- 1),^ dimension).  There  are  {n-\)\  different 
ways.  Then,  for  each  x,._i  where  ^  /,._i ,  regard  the  butterfly  in 

STM (/j, 4,..., as  the  anchor  butterfly.  Repeat  step  2  until  step  i-l,  the 
unfilled  locations  in  STM(:,;,...,:,x,._j, .,/2j_j)  will  be  fdled  by  butterflies  from 
certain  simplex-transitioni-butterfiy-sets,  simplex -transitions-butterfiy-sets,  ....  , 

simplex-transitioni-i-butterfiy-sets.  The  locations  of  all  these  butterflies  used  to  fill  are 
fixed;  because  when  repeating  step  2  until  step  i-\,  the  order  of  placing  the 
butterflies  constituting  simplex-transitionk  where  A:  =  2,3,...,/ -  1  with  this  butterfly 
into  STM(/j,4,...,x^_j,/^,...,/,._2,A-p/,v,/fl_i)  where  will  be  fixed  by 

cross-checking  the  memberships  in  the  simplex-transitioni-butterfiy-sets  containing  the 
butterflies  in  STM(/j,/2,...,x^_i,/^,...,/,_2,/,-i,/,,---,4._i)  where  Xj_i=://^_i.  The 
locations  of  those  butterflies  have  been  fixed  in  the  previous  steps.  Then  the  locations 
of  all  the  rest  of  the  butterflies  that  should  be  placed  in  are 

fixed.  The  internal  orders  of  all  butterflies  are  fixed  using  Procedure  3.1. 

We  can  see  from  Procedure  3.2,  the  D  +  3  times  choice  defined  in  STM-EREE 
totally  fix  an  STM.  Changing  one  butterfly’s  internal  order  or  the  order  of  placing  one  set 
of  the  n  butterflies  along  the  /,^  dimension  will  cause  corresponding  change  on  all  the 
other  butterfly’s  internal  order  or  the  order  of  placing  all  the  other  sets  of  the  n  butterflies 
along  the  dimension,  /  =  1,2,...,0 - 1 .  This  implies  that  one  butterfly’s  internal  order 
will  fix  the  internal  order  of  all  the  other  butterflies,  i.e.,  define  STM  (left  side  butterfly, 
right  side  butterfly).  The  order  of  placing  one  set  of  the  n  butterflies  along  the 
/,;,  dimension  of  STM  will  fix  the  order  of  placing  all  the  other  sets  of  n  butterflies  along 
the  /,^  dimension,  i.e.,  define  STM-EREE  (z);,  dimension).  Placing  the  first  selected 
butterfly  in  a  location  other  than  STM(l,l,...,l)and  keeping  the  other  members  in  STM- 
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FREE  the  same  will  result  in  a  different  STM.  It  ean  be  verified  that  this  resultant  STM 
ean  also  be  built  by  first  ehoosing  the  butterfly  in  the  this  resultant  STM(l,l,...,l)as  the 
first  seleeted  butterfly,  then  plaeing  it  in  STM(1,1,...,1)  and  defining  other  members  in 
STM-EREE  aeeordingly.  This  shows  that  we  ean  always  plaee  the  first  seleeted  butterfly 
in  STM(1,1,...,1)  and  still  ean  get  all  the  different  STM’s  by  defining  the  other  members 
in  STM-EREE.  This  gives  the  total  number  of  different  STM’s  for  HDCTCM(n,Z))  as 
■n\-n\-((n  - 1)!)^  * . 

3,2,6  Example  of  Building  STM 
Example  3,6  Build  STM  for  HDCTCM(4,3) 

All  sets  of  butterflies  eonstituting  simplex-transition2  and  simplex-transition3  are  listed  in 
Example  3.4.  The  2-dimensional  STM  will  be  built  as  follows: 

1 .  Seleet  any  butterfly,  arrange  its  internal  order  arbitrarily,  and  plaee  it  into  any  loeation 
In  Eigure  3.7(a),  butterfly  1  is  ehosen  and  plaeed  in  STM (2, 3). 

2.  Build  the  first  dimension. 

Simplex-transition2-butterfiy-set  eontaining  butterfly  1  is  butterfly {1,  2,  4,  10}.  So, 
butterfly  2,  4,  and  10  are  plaeed  in  loeations  STM  (1,3),  STM  (3, 3)  and  STM  (4, 3)  in 
an  arbitrary  order.  The  internal  orders  of  them  are  fixed  with  respeet  to  butterfly  1 
using  Proeedure  3.1  (see  Eigure  3.7  (b)). 

3 .  Build  the  seeond  dimension. 

Simplex-transition3-butterfiy-set  eontaining  butterfly  1  is  butterfly {1,  3,  5,  15} .  So, 
butterfly  3,  5,  and  15  are  plaeed  into  loeations  STM(2,1),  STM(2,2),  and  STM(2,4) 
in  an  arbitrary  order.  Their  internal  orders  are  fixed  with  respeet  to  butterfly  1  using 
Proeedure  3.1  (see  Eigure  3.7(e)).  Eor  butterflies  3,  5,  and  15,  the  other  3  butterflies 
eonstituting  simplex-transition2  with  them  are  butterfly  6,  9,  and  12,  butterfly  7,  8,  and 
14  and  butterfly  11,  13,  and  16.  They  will  be  plaeed  into  the  rest  loeations  in 
STM(:,2),  STM(:,1),  and  STM(:,4),  respeetively.  Their  loeation  indexes  along  the 
first  dimension  will  be  fixed  by  eross-eheeking  the  membership  in  three  sets  of 
simplex-transition3-butterfly-set  eontaining  butterflies  in  STM  (1,3),  STM (3, 3),  and 
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STM(4,3).  They  are  butterfly {2,  6,  8,  11},  butterfly {10,  12,  14,  16},  and 
butterfly (4,  9,  7,  13}.  So,  butterfly  6,  9,  and  12  should  be  plaeed  into  STM(:,2)  and 
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Figure  3.7  Build  STM  for  HDCTCM  (4,3) 
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have  the  same  loeation  index  along  the  first  dimension  as  butterfly  2,  4,  and  10  in 
STM(:,3)-  And  their  internal  orders  are  fixed  with  respeet  to  butterfly  2,  4,  and  10 
using  Proeedure  3.1.  Similarly,  STM(:,1)  and  STM(:,4)  are  fdled  properly  (see  Figure 
3.7(d)). 


3,3  Designs  of  Signal  Constellation  and  Symbol  Assignment 

In  this  seetion,  the  simplex  signal  eonstellation  is  eonstrueted  in  a  high 
dimensional  spaee  and  the  mapping  rule  between  the  signal  eonstellation  and  the  sate 
transitions  is  designed. 


3,3,1  Algebraic  Representation  of  Simplex 

A  simplex  is  a  set  of  M  signals  in  an  N -dimensional  spaee  with  N>  M -\, 
satisfying  (2.6).  For  HDCTCM(n,Z)) ,  a  simplex  is  to  be  assigned  to  a  set  of  n  state 
transitions,  that  is  to  say  we  need  a  simplex  that  eontains  M  =  n  signals.  In  eireular  trellis 
with  permuted  state  strueture,  n  is  the  size  of  information  symbol  alphabet  size.  Non¬ 
binary  transmission  are  often  more  effieient  than  binary  transmission  [36],  and  when 
M>  4,  the  energy  saving  of  simplex  signaling  over  orthogonal  signaling  is  not 
signifieant  [33].  So,  in  this  dissertation,  M=4  is  ehosen  for  the  most  praetieal 
HDCTCM(4,Z)).  When  M  =  4,  N>3,  this  means  that  a  three-dimensional  spaee  is  the 
smallest  signal  spaee  to  build  a  simplex  that  eontains  four  member  signals. 

We  introduee  an  algebraie  representation  for  simplex.  A  simplex  signal  s. ,  where 
i  =1,2, 3,4,  is  represented  as  a  veetor  {±a,±b,±c),  where  a,b,c  e{l,2,...,A}  and  N  is  the 
dimension  of  the  signal  spaee.  This  representation  means  signal  5,  has  negative  (-)  or 
positive  (+)  unit  pulses  in  the  b,^,  and  spaee  dimension  and  O’s  in  all  the  other 
spaee  dimensions.  We  name  the  element  in  this  veetor  representation  as  pulse-loeation 
and  the  element  where  i  =1,2,3  as  pulse-loeationi.  The  value  of  pulse-loeatioui  is  a 
signed  integer.  In  signal  5,  ,  the  ±a,  ±b  and  ±c  are  the  values  of  pulse-loeationi,  pulse- 
looation2,  and  pulse-loeations  respeetively.  We  eall  this  signaling  seheme  the  3-out-of-N 
simplex  signaling  seheme.  Call  a,  b ,  and  c  the  spaee  dimensions  oeeupied  by  a  signal 
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(or  a  simplex,  or  pulse-locations).  The  corresponding  normalized  signal  s.  is 
■^(±a,±b,±c).  A  simplex  will  be  written  as  simplex {5,.  |  /  =  1,2,3,4}. 

Two  types  of  simplexes  are  designed  for  the  signal  constellation. 

1 .  Type  A  simplex— also  referred  to  as  source  simplex— in  which  all  its  four  member 
signals  occupy  the  same  three  dimensions. 

There  are  only  two  subtypes;  each  has  either  odd  or  even  number  of  negatives  in  all  its 
member  signals  referred  to  as  even  or  odd  source  simplex  (see  Figure  3.8).  When  we 
write  a  simplex  in  the  way  as  in  this  figure,  we  regard  a  simplex  as  an  ordered  structure 
and  the  location  of  a  signal  in  the  simplex  is  referred  to  as  the  internal  location  of  the 
signal  in  this  simplex.  Number  1,  2,  and  3  refer  to  the  three  different  dimensions,  not 
necessarily  the  first  three  dimensions  in  an  A -dimensional  space. 

12  3  12-3 

1-2-3  1-2  3 

-12-3  -12  3 

-1-2  3  -1-2-3 

Figure  3.8  Two  subtypes  of  type  A  simplex 

2.  Type  B  simplex,  in  which  no  two  member  signals  occupy  the  same  three  dimensions. 
The  total  number  of  the  occupied  dimensions  of  a  type  B  simplex  is  6  (see  Figure  3.9 
(a)).  Notice  a  "copy”  rule  in  this  representation.  By  “copy”  we  mean,  in  a  pair  of  signals, 
one  pulse-location  has  the  same  absolute  value  but  opposite  sign.  For  instance,  in  Figure 
3.9  (a)  in  the  first  two  signals,  pulse-locationi  is  1,  and  -1  respectively.  This  means  these 
two  signals  related  to  each  other  by  “copy”  rule  for  pulse-locationi .  In  a  type  B  simplex,  a 
pair  of  signals  related  to  each  other  by  “copy”  rule  for  pulse-locatioui,  where  /=  1,2,3 ,  is 
called  a  signal  pair  for  pulse-locationi.  Their  locations  in  this  simplex  are  called  a  location 
pair  for  pulse-locationi.  It  can  be  verified  from  Figure  3.9  (a)  that  any  two  signals  can 
constitute  a  signal  pair  for  a  certain  pulse-locationi.  For  each  pulse-locationi,  the  four 
member  signals  in  a  type  B  simplex  constitute  two  signal  pairs.  Define  the  location  of  a 
signal  in  a  simplex  from  top  to  bottom  as  1,  2,  3,  and  4.  In  Figure  3.9  (a),  the  first  two 
signals  and  the  second  two  signals  are  the  two  signal  pairs  for  pulse-locatoini.  The  two 
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location  pairs  for  pulse-locationi  are  locations  (1,2)  and  locations  (3, 4) .  All  location  pairs 
for  all  pulse-locationi’s,  where  /  =  1,2,3,  are  listed  in  a  matrix  called  pair. 
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pair  = 


1 
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1 

3 
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1  3  5 
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Figure  3.9  (a)  A  type  B  simplex  (b)  4  type  B  simplexes  formed  from  4  source  simplexes 
related  to  the  four  signals  in  the  type  B  simplex  in  (a) 


The  two  location  pairs  for  pulse-locationi  are  listed  in  the  column  of  this 
matrix.  They  are  locations  (pair(l,z),  (2,z))  and  locations  (pair(3,z),  (4,z)).  Each  of  the 
two  locations  in  a  location  pair  is  called  a  pair  location  of  the  other  location.  From 
Equation  (3.2),  it  can  be  verified  that  for  a  given  signal  location,  its  pair  location  for 
pulse-locationi  and  pulse-locationj,  where  j ,  are  different. 

Each  member  signal  in  a  type  B  simplex  is  a  member  signal  in  a  type  A  simplex 
that  occupies  the  same  three  space  dimensions  as  this  signal.  Call  this  type  A  simplex  the 
related  source  simplex  to  this  signal.  For  instance,  a  member  signal  (1,  3,  5)  in  type  B 
simplex,  shown  in  Figure  3.9  (a),  is  related  to  the  source  simplex  {(1,  3,  5),  (1,  -3,  -5),  (- 
1,  3,  -5),  (-1,  -3,  5)}.  Four  member  signals  in  a  type  B  simplex  will  relate  to  four  source 
simplexes.  It  can  be  verified  that  there  is  one  and  only  one  way  to  arrange  these  four 
source  simplexes  to  form  four  type  B  simplexes  with  each  member  signal  of  a  formed 
type  B  simplex  drawn  from  a  different  source  simplex.  For  the  four  source  simplexes 
related  to  the  four  signals  in  the  type  B  simplex  shown  in  Figure  3.9  (a),  the  only 
arrangement  to  form  four  type  B  simplexes  is  shown  in  Figure  3.9  (b).  The  set  of  four 
signals  in  each  row  come  from  a  same  source  simplex,  and  the  four  signals  in  each 
column  form  a  type  B  simplex. 
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3,3.2  The  Idea  of  Symbol  Assignment 

For  HDCTCM(4,Z)),  our  goal  is  to  build  a  signal  constellation  with  total 
S-n  =  4^^'  symbols  and  assign  them  to  the  4^^’  state  transitions  in  STM  such  that  all 
sets  of  4  transitions  eonstituting  simplex-transitioni’s,  i  =  \,2,...,D +  \  are  assigned 
simplexes.  In  STM,  a  simplex-transitioni  is  in  a  butterfly;  the  four  transitions  in  it  have  a 
same  originating  state.  A  simplex-transitionD+i  is  in  a  butterfly  with  eaeh  of  its  transitions 
originating  from  a  different  originating  state  in  this  butterfly.  A  simplex-transitioui, 
i  =2,3,...,D ,  is  the  set  of  4  transitions  in  the  same  internal  loeation  of  the  four 
butterflies  along  the  (z-1),/,  dimension  of  STM  with  eaeh  of  its  transition  originating 
from  one  of  the  four  originating  states  in  the  same  internal  loeation  of  these  four 
butterflies. 

The  idea  is  to  relate  eaeh  of  the  member  signals  Sj,  7=  1,2, 3, 4  of  a  type  B 

simplex  to  eaeh  of  the  originating  state  in  a  butterfly  in  STM  or  to  eaeh  of  the  four 
originating  states,  whieh  are  in  the  same  internal  loeation  of  the  set  of  four  butterflies 
along  the  (i-l);/,  dimension  of  STM,  i  =2,3,...,D .  Denote  the  originating  state  to  whieh 
the  signal  Sj  is  related  as  g^.  In  our  symbol  assignment,  the  four  state  transitions 
originating  from  state  (a  simplex-tamstinoni,  denoted  as  the  simplex-transitioni 
originating  from  state  g^)  will  be  assigned  the  member  signals  from  the  related  souree 
simplex  to  signal  Sj,  denoted  as  m..  In  this  way,  a  simplex-tarnstinoni  is  assigned  a 
souree  simplex.  We  eall  this  source  simplex,  m.,  the  related  souree  simplex  to  this 
originating  state  g^  or  the  related  souree  simplex  to  the  simplex-transitioni  originating 
from  state  g^.  Then  the  4  simplex-transtionl’s  originating  from  g^,  for  all  A: ,  A:  =  1,2, 3, 4 
will  be  assigned  using  the  four  related  source  simplexes  tUj ,  j  =  1,2,3, 4 . 

As  known  from  the  illustration  of  simplex-transitions  in  butterflies,  when  the  four 
originating  state  g^,  for  all  k ,  A:  =  1,2, 3, 4,  are  in  a  butterfly  in  STM,  the  four  simplex- 
transitioni’s  originating  states  g^,  also  eonstitute  four  simplex-transitiouD+i’s,  with  eaeh 
transition  in  a  simplex-transitiono+i  drawn  from  a  different  simplex-transitioni.  When  the 
four  originating  states  g^.  are  in  the  same  internal  loeation  of  four  butterflies  along  the 
(z-1),^  dimension  in  STM,  the  four  simplex-transitioni’s  originating  states  g^.  will 
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constitute  four  simplex-transitioui’s  with  each  transition  in  a  simplex-transitioni  drawn 
from  a  different  simplex-transitioni.  Shown  in  Figure  3.10  (a)  are  the  transitions  in  a 
butterfly — ^butterfly  1  in  STM  built  for  HDCTCM(4,3)  in  Example  3.6.  Figure  3.10  (b) 
shows  the  transitions  originating  from  the  four  originating  states  in  one  set  of  four 
butterflies  along  the  second  dimension  in  that  STM.  The  set  of  four  transitions,  each 
having  a  different  line  style,  is  a  simplex-transitioni.  The  set  of  four  transitions  having  the 
same  line  style  is  a  simplex-transitioru  in  Figure  3.10  (a)  and  a  simplex-transition3  in 
Figure  3.10  (b). 


(1,3,5),  (l,-3,-5),  (-1  ,3,-5),  (-l,-3,5) 

1 

(-1,4,6),  (-l,-4,-6),  (1  ,4,-6),  (l,-4,6) 

64 

(2,-3,-6),  (2,3,6),  (-2,-3,6),  (-2,3,-6) 

4 

(-2,-4,-5),  (-2,4,5),  (2,-4,5),  (2,4,-5) 

33 

(a) 


Figure  3.10  Symbols  assignment  for  the  transitions  originating  from  four  originating  states 
which  are  (a)  in  a  butterfly  in  STM  and  (b)  in  the  same  internal  location  of  a  simplex- 

transtitioni-butterfly-set  in  STM 

Each  of  these  four  simplex-transitionD+i’s  or  simplex-transitioni ’s  ,  i  =2,3,...,D , 
should  also  be  assigned  a  simplex.  We  have  shown  that  there  is  one  and  only  one  way  to 
arrange  these  four  related  source  simplex  m. ,  /  =  1,2,3, 4,  to  form  four  type  B  simplexes, 

denoted  as  /  =  1,2,3, 4,  with  each  member  signal  of  drawn  from  a  different  source 
simplex  mj .  This  says  we  can  arrange  the  order  of  assigning  the  signals  in  source  simplex 
m.  to  the  transitions  originating  from  state  such  that  these  four  simplex-transitiouD+i’s 
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or  simplex-transitioiii’s  be  assigned  the  four  type  B  simplexes  4}.  Let  us  see  how  to  do 
this  in  the  following  example. 

Example  3.7  Symbols  assignment  for  the  transitions  originating  from  four  originating 
state  in  a  butterfly  in  STM  or  four  originating  states  in  the  same  internal  loeation  of  the 
set  of  four  butterflies  along  the  (z  - 1)^^  dimension  in  STM 

In  Figure  3.10  (a),  we  relate  the  four  signals  from  top  to  bottom  in  the  type  B 
simplex  shown  in  Figure  3.9  (a)  to  the  four  originating  state  1,  64,  4,  and  33  respeetively. 
Then  the  souree  simplex  in  eaeh  row  from  row  1  to  row  4  in  Figure  3.9  (b)  will  be 
assigned  to  the  simplex-transitioni’s  from  originating  state  1,  64,  4,  and  33  respeetively. 
The  only  eombination  of  arranging  these  four  souree  simplexes  to  form  four  type  B 
simplexes  is  in  Figure  3.9  (b).  First,  we  ean  ehoose  any  simplex-transitioni  and  assign  the 
related  souree  simplex  to  it  arbitrarily.  Say  we  ean  assign  the  simplex-transitioni  from 
originating  state  1  from  top  to  bottom  in  this  butterfly  the  signals  (1,  3,  5),  (1,  -3,  -5),  (-1, 
3,  -5),  and  (-1,  -3,  5),  respeetively.  Then  the  symbols  assigned  to  the  other  simplex- 
transitioni’s  will  be  fixed.  The  reason  is  as  follows.  We  have  known  the  symbols  assigned 
to  the  simplex-transitioni  from  one  of  the  originating  states.  That  is  to  say,  for  eaeh 
simplex-transition4,  we  have  known  the  symbol  assigned  to  one  transition  in  this  simplex- 
transition4.  This  symbol  is  a  member  signal  of  one  of  the  four  type  B  simplexes;  say,  , 
zn  =  l,2,3,4  in  Figure  3.9  (b).  Then  in  order  to  make  this  simplex-transition4  to  be 
assigned  a  type  B  simplex,  the  other  three  transitions  in  this  simplex-transition4  should  be 
assigned  the  other  three  member  signals  in  this  type  B  simplex  .  In  this  example, 
knowing  transition  1  ^  1  is  assigned  signal  (1,  3,  5),  whieh  is  a  member  signal  of  type  B 
simplex  1  in  Figure  3.9  (b),  the  other  three  transitions  in  the  simplex-transition4  having 
the  next  state  1,  64  ^  1 6,  4  ^  land  33  1  should  be  assigned  the  rest  of  the  signals  in 
type  B  simplex  1  in  Figure  3.9  (b),  i.e.,  (-1,  4,  6),  (2,  -3,  -6)  and  (-2,  -4,  -5).  In  this  way, 
all  the  transitions  from  originating  state  64,  4,  and  33  are  assigned  proper  symbols  from 
the  related  souree  simplexes.  In  Figure  3.10  (a),  the  signals  assigned  to  the  four 
transitions  from  an  originating  state  from  top  to  bottom  in  this  butterfly  are  listed  beside 
that  originating  state  from  left  to  right.  The  four  simplex-transition4’s  having  the  next 
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state  1,  2,  5,  and  34  are  assigned  type  B  simplex  1,  2,  3,  and  4,  as  shown  in  Figure  3.9  (b), 
respectively. 

Similarly,  we  related  the  signals  in  the  type  B  simplex  in  Figure  3.9  (a)  from  top 
to  bottom  to  the  four  originating  states  63,  13,  64  and  32  in  Figure  3.10  (b).  Arbitrarily 
assign  one  simplex-transitioni  from  an  originating  state  using  the  related  source.  For 
example,  assign  the  four  transitions  originating  from  state  63  from  top  to  bottom  the 
signals  (1,  -3,  -5),  (-1,  3,  -5),  (1,  3,  5),  (-1,  -3,  5),  respectively.  Then  similarly  as  in  Figure 
3.10  (a),  all  the  transitions  from  originating  state  13,  64,  and  32  will  be  assigned  proper 
symbols  from  the  related  source  simplexes.  The  four  simplex-transition4’s  from  top  to 
bottom  are  assigned  type  B  simplex  2,  3,  1,  and  4,  as  showed  in  Figure  3.9  (b). 

This  example  shows  that  after  knowing  the  signals  related  to  the  four  originating 
states,  the  symbols  assigned  to  the  simplex-transitioni ’s  from  any  one  originating  state 
will  fix  the  symbols  assigned  to  the  other  simplex-transitioni ’s  from  the  other  originating 
states. 

In  summary,  we  want  to  build  a  total  number  of  S  type  B  simplex  signals  and 
relate  each  of  the  originating  state  in  a  butterfly  in  STM,  A:  =  1,2, 3,4 ,  to  a  signal  Sj  in 

a  type  B  simplex,  j  =1,2,3, 4.  In  the  mean  time,  we  want  the  signals  related  to  the  four 
originating  states,  which  are  in  the  same  internal  locations  of  the  set  of  four  butterflies 
along  the  (i-1),;,  dimension,  are  also  member  signals  from  a  type  B  simplex  for 
i  =2,3,...,Z).  Then  by  assigning  the  related  source  simplex  to  to  the  four  transitions 
originating  from  g^  in  a  proper  way,  each  of  all  the  simplex-transitioni ’s  in  STM  will  be 
assigned  a  source  simplex;  and  each  of  the  simplex-transitioni’s,  i  =2,3,...,D  +  \,  will  be 
assigned  a  type  B  simplex.  This  gives  the  idea  of  building  these  S  signals. 

We  will  regard  a  type  B  simplex  as  a  unit  element  with  an  ordered  structure  and 
replace  a  butterfly  in  STM  with  a  type  B  simplex.  Name  the  new  matrix  as  initial  input 
simplex  (IIS).  Similarly,  a  location  in  IIS  is  referred  to  using  IIS(Xj,X2,  ...,x.,...,x^j).  If 
we  can  make  the  signals  in  the  same  internal  location  of  the  four  type  B  simplexes  along 
the  (z-1),/,  dimension  of  IIS  also  a  type  B  simplex,  then  we  can  build  a  one-to-one 
mapping  between  the  originating  state  in  STM  and  signals  in  IIS,  such  that  a  set  of  four 
signals  in  the  same  internal  locations  of  the  four  type  B  simplexes  along  the 
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(/-I),;,  dimension  of  IIS— IIS(Xj,X2,  is  related  to  the  set  of  four  states 

in  the  same  internal  locations  of  the  set  of  four  butterflies  along  the  (z-l)^;,of  STM— 
STM(xj,X2, ...,x,._2,:,.r,.,...,X2j_j).  Also,  make  the  four  originating  states  in  a  butterfly  in 
STM  related  to  a  type  B  simplex  in  IIS.  Then,  by  assigning  the  simplex-transitioni 
originating  from  a  state  the  related  source  simplex  properly,  all  the  simplex-transitioui, 
z  =1,2,...,Z)  +  1,  will  be  assigned  simplex.  In  this  way,  the  signal  constellation  for 
HDCTCM(4,Z))  consists  of  all  the  source  simplexes  related  to  all  the  signals  in  IIS. 


3,3,3  Build  Initial  Input  Signal 

The  section  will  build  IIS.  First,  we  will  describe  how  to  build  a  type  B  simplex  in 

Procedure  3.3. 

Procedure  3,3  Build  a  type  B  simplex 

A  type  B  simplex  occupies  six  distinct  space  dimensions.  Number  them  from  1  to  6. 

1 .  Select  any  three  of  these  six  dimensions  and  give  them  any  sign  to  build  a  signal.  And 
place  it  in  location  1  of  this  simplex  (see  Figure  3.11  (a)).  From  Equation  (3.2), 
location  1  is  the  first  location  in  the  first  location  pair  for  all  pulse-locationi, 
z=l,  2,  3. 


3  5 

1  3  5 

1  3  5 

-1 

-14  6 

-3 

2  -3  -6 

-5 

-2  -4  -5 

(a) 

(b) 

(c) 

Figure  3,11  Build  a  type  B  simplex 
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2.  For  each  pulse-locatioiii,  z  =1,  2,  3,  from  Equation  (3.2),  find  the  other  location  in  the 
first  location  pair;  it  is  location  pair(2,z).  “Copy”  the  exiting  value  to  that  location 
(see  Figure  3.11  (b)).  For  pulse-locatioui,  z  =1,  2,  3,  its  value  is  copied  to  location  2, 
3,  and  4,  respectively,  in  this  simplex. 

3.  For  each  pulse-locationi,  “fill”  the  first  location  in  the  second  location  pair,  i.e., 
location  pair(3,z),  using  a  new  dimension  and  “copy”  to  its  pair  location  pair(4,z).  The 
sign  of  pulse-locationi  used  to  “fill”  is  the  same  as  the  sign  of  pulse-locationi  in  the 
first  location  of  the  first  location  pair  (see  Figure  3.11  (c)).  For  pulse-locationi,  the 
second  location  pair  is  location  (3,  4),  “fiU”  location  3  using  a  new  space  dimension  2; 
“copy”  it  to  location  4  as  -2. 

This  procedure  will  be  extended  to  build  the  IIS.  It  starts  from  a  type  B  simplex 
placed  in  the  first  location  in  IIS,  and  then  applies  “copy”  and  “fill”  operations  along  each 
matrix  dimension  of  IIS.  The  location  1,  2,  3,  and  4  in  matrix  pair  will  be  the  location 
index  along  the  z dimension,  z  =l,2,...,Z)-l. 

Procedure  3,4  Build  IIS 

1.  Put  the  first  type  B  simplex  in  IIS(1,  1,  ...,  1).  Take  HDCTCM(4, 4)  trellis  as  an 
example  (see  Figure  3.12  (a)). 

2.  Regard  this  type  B  simplex  as  a  unit.  Extend  along  the  first  matrix  dimension  of  IIS. 
First,  for  each  pulse-locationi,  z  =  1,  2,  3 ,  “copy”  the  existing  values  to  the  other  location 
of  the  first  location  pair,  i.e.,  IIS  (paz>(2,z),  I,  ...,  I)  (see  Figure  3.12  (b)).  Then 
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Figure  3.12  Build  IIS  for  HDCTCM(4, 4) 
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Figure  3.12  (cont.) 
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Figure  3.12(cont.) 


for  each  pulse-locatioiii,  for  the  locations  in  the  second  location  pair,  “fill”  the  first 
location,  US  {pair  {Xi),  1,  1),  using  two  new  dimensions  and  “copy”  to  its  pair 

location,  \\S{pair{A,i),  1,  ...,  1).  The  values  used  to  “fdl”  comply  with  “copy”  rule 
and  have  the  same  sign  pattern  as  pulse-locationi  in  the  first  location  of  the  first 
location  pair  (see  Figure  3.12  (c)). 

3.  Extend  along  the  second  matrix  dimension.  We  can  take  all  the  four  type  B  simplexes 
along  the  first  dimension  as  a  whole  from  now  on.  When  filling  a  pulse-locationi,  four 
new  dimensions  are  needed,  and  “copy”  rule  and  sign  pattern  for  that  pulse-locationi 
are  the  same  as  pulse-locationi  in  IIS(:,  1,  ...,  1).  First,  for  each  pulse-locationi, 
i  =  1,  2,  3  “copy”  the  existing  values  to  the  second  location  in  the  first  location  pair, 
\\S{:,pair{l,i),  1,  ...,  l)(see  Figure  3.12  (d)).  Then  for  each  pulse-locationi,  “fill”  the 
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first  location  in  the  second  location  pair,  1,  1),  and  “copy”  to  its 

pair  location,  IIS 4, i),  I,  ...,  I) (see  Figure  3.  12(e)). 

4.  Extend  along  the  third  matrix  dimension.  First,  for  eaeh  pulse-locationi,  “copy”  all  the 
existing  values  to  its  pair  loeation;  it  is  \\S{: ,pair{2,i),  1,  ...,  l)(see  Figure  3.12  (f), 
(g),  and  (h)).  Then,  for  eaeh  pulse-loeationi,  “fill”  the  first  location  in  the  second 
location  pair,  IIS(:,:,/>a/r(3,/),  1,  ...,  1)  and  “copy”  to  its  pair  location, 
IIS(:,:,pai>(4,i),  1,  ...,  1).  This  time,  the  “fiU”  is  on  a  two-dimensional  plane  with  no 
existing  pulse-loeationi’ s  on  it,  so  the  first  loeation  from  both  loeation  pairs  needs  to  be 
filled,  then  “copy”  them  to  their  pair  loeation  (see  Figure  3.12  (i),  (j),  and  (k)). 

5.  Continue  this  way  until  extending  IIS  to  the  (O  - 1),^  matrix  dimension.  Eaeh  time, 
extend  IIS  to  one  more  dimension,  in  step  j ,  “copy”  the  existing  values  to  its  pair 
location  along  the  (y-l);/,  dimension,  i.e.,  IIS(:, :,..., />a/r(2,/),l, ..., 1)  .  Then,  for  eaeh 

y-2  D-j 

pulse-loeationi,  for  the  locations  in  the  second  location  pair  along  the  (y-l),/, 
dimension,  “fiU”  the  first  loeation,  IIS(:,:,...,/>a/r(3,/),l,— ,1)  and  “copy”  to  its  pair 

7-2  D-j 

location  IIS (:,:,..., />a/r(4,/),l,...,l)  .  The  “fiU”  is  on  a  y  -  2 -dimensional  matrix  with 


7-2  D-j 

no  existing  pulse-locationi ’s  on  it,  so,  it  contains  “fill”  the  first  locations  in  both  the 
location  pairs  along  the  {j-2)^^  dimension,  IIS (:,:,...,y>az>(l,z),y>az>(3,z),l, •••,!)  and 

7-3  D-j 

IIS  (:,:,...,y>az>(3,z),y>az>(3,z), !,...,!)  and  “copy”  to  their  pair  location, 

7-3  D-j 

IIS  pair{2,i), pair{3,i),\,...,Y)  and  IIS  pair(\,i),pair(3,i),\,...,\) . 

7-3  D-j  7-3  D-j 

Recursively,  that  will  contain  “fill”  and  “copy”  along  the  {j  -  3)^^  dimension,  until  the 
“fill”  and  “copy”  along  the  second  dimension  of  IIS  in  step  3. 

In  this  way,  for  HDCTCM(4,Z))  trellis,  the  total  distinct  signal  dimensions 

needed  to  build  IIS  is  =  6  •  2^  ’ .  The  signal  dimension  ean  be  frequency  or  time  slot 
when  the  signal  is  aetually  transmitted. 
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3,3.4  The  Procedure  of  Symbol  Assignment 

After  IIS  is  built,  the  mapping  between  the  originating  states  in  STM  and  signals 
in  IIS  has  been  stated  in  the  previous  seetion,  whieh  serves  as  the  guide  for  building  the 
IIS.  As  seen  in  Example  3.7,  the  symbol  assigned  to  a  partieular  transition  will  ehange  if 
we  ehange  the  order  of  mapping  the  four  signals  s  .  in  a  type  B  simplex  to  the  four 
originating  states  in  a  butterfly  or  the  four  originating  states  in  the  same  internal  loeations 
of  the  set  of  four  butterflies  along  the  (i-1),/,  dimension  of  STM.  The  same  symbol 
assignment  ean  be  obtained  by  keeping  a  fixed  mapping  order  and  ehanging  the  order  of 
the  four  originating  states  in  a  butterfly  (defined  by  STM-FREE  (left  side  butterfly))  or 
the  order  of  the  four  butterflies  along  the  (z-1),/,  dimension  (defined  by  STM-FREE 
((z  - 1)^^  dimension).  That  is  to  say,  we  ean  get  the  same  symbol  assignment  if  we  fix  the 
mapping  order  and  use  different  STM  built  by  ehanging  the  STM-FREE  (left  side 
butterfly)  and  STM-FREE  ((z  - 1),^  dimension).  In  our  symbols  assignment,  we  will  fix 
the  mapping  order  and  leave  the  different  symbol  assignments  to  employing  different 
STM-FREEs.  The  originating  state  having  an  internal  loeation  in  the  butterfly  loeated  at 
STM(/j,/2,...,/^_j)  will  be  mapped  to  the  signal  that  has  the  same  internal  loeation  in  the 
type  B  simplex  loeated  at  IIS(/j,4,...,4,,i) .  Then  the  four  transitions  from  eaeh 
originating  state  in  STM  will  be  assigned  using  the  related  souree  simplex  and,  as  shown 
in  Example  3.7,  the  order  of  assigning  the  four  signals  in  this  related  souree  simplex  to 
these  four  transitions  ean  be  arranged  properly  sueh  that  eaeh  of  all  the  simplex- 
transitioni’s,  z  =\,2,...,D  +  \,  is  assigned  a  simplex.  We  will  work  out  an  example  to  see 
how  to  make  the  symbol  assignment  after  the  mapping  order  between  the  originating 
states  in  STM  and  signals  in  IIS  is  fixed. 

Example  3,8  Symbol  assignment  for  HDCTCM(4,3) 

The  IIS  is  built  as  in  Figure  3.12(e).  Else  the  STM  built  in  Example  3.6. 

1.  Start  the  symbol  assignment  from  the  first  originating  state  in  the  first  butterfly  in 
STM,  i.e.,  butterfly  loeated  at  STM(1,1).  The  originating  state  26  is  related  to  signal 
(1,  3,  5).  Then  the  four  transitions  originating  from  the  state  26  (simplex-transitioni 
having  state  26  as  originating  state)  should  be  assigned  the  related  souree  simplex  {(1, 
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3,  5),  (1,  -3,  -5),  (-1,  3,  -5),  (-1,  -3,  5)}.  The  order  of  assigning  these  four  signals  to 
these  four  transitions  is  flexible.  But  if  a  particular  one  is  chosen,  as  we  will  see,  it  will 
fix  the  order  of  assigning  all  the  simplex-transitioni’s  from  all  the  other  originating 
states  in  STM  using  the  related  source  simplexes.  We  assign  the  four  transitions 
originating  from  state  26  from  top  to  bottom  in  this  butterfly,  i.e.,  26  ^  13  ,  26  ^  27 , 
26^53  and  26^55  the  signals  (1,  3,  5),  (1,  -3,  -5),  (-1,  3,  -5),  and  (-1,  -3,  5), 
respectively.  This  order  can  be  identified  from  the  locations  of  negative  signs  in  these 
four  signals. 

2.  Then  consider  the  other  three  originating  states  12,  54  and  52  in  this  butterfly.  They 
relate  to  signal  (-1,  4,  6),  (2,  -3,  -6),  and  (-2,  -4,  -5),  respectively.  The  related  source 
simplex  to  each  of  these  signals  will  be  assigned  to  the  four  transitions  originating 
from  state  12,  54,  and  52,  respectively.  From  Example  3.7,  the  symbols  assigned  to  the 
simplex-transitioni’s  originating  from  state  26  will  fix  the  symbols  assigned  to  the 
other  simplex-transitioni’s  from  the  other  originating  states  in  this  butterfly.  Then,  all 
the  transitions  in  the  butterfly  located  at  STM(1,1)  are  assigned  proper  symbols. 

3.  Then  we  will  consider  transitions  in  the  other  n-\  butterflies  constituting  simplex- 
transition2  with  the  first  butterfly.  They  are  located  along  the  first  dimension  of  STM, 
i.e.,  at  locations  STM(Xj,l)  ,  where  Xj  =:/l .  For  each  of  the  four  internal  locations  that 
an  originating  state  can  have,  consider  the  four  originating  states  in  that  internal 
location  of  the  four  butterflies  located  at  STM(:,1).  From  the  previous  step,  we  know 
the  symbols  assigned  to  the  simplex-transitioni  originating  from  the  originating  state 
in  the  butterfly  located  at  STM (1,1).  Then  from  Example  3.7,  the  symbols  assigned  to 
all  the  transitions  originating  from  the  originating  state  in  butterflies  located  at 
STM  (2,1)  and  STM  (3,1)  and  STM  (4,1)  will  be  fixed.  For  instance,  the  four 
originating  states  12,  63,  31,  and  62  along  the  first  dimension,  knowing  the  symbols 
assigned  to  the  simplex-transitioni  from  originating  state  12  will  fix  the  symbols 
assigned  to  the  simplex-transitioni’s  from  originating  state  63,  31,  and  62.  In  this  way, 
all  the  other  transitions  in  butterflies  located  in  STM(2,1),  STM(3,1),  and  STM(4,1) 
are  assigned  proper  symbols. 

3.  After  knowing  the  symbols  assigned  to  the  transitions  in  butterflies  located  in 
STM(:,1),  we  can  assign  symbols  to  transitions  in  the  set  of  four  butterflies  along  the 
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second  dimension  of  STM.  Consider  the  four  originating  state  in  the  same  internal 
location  of  these  four  butterflies.  From  the  previous  step,  we  have  known  the  symbols 
assigned  to  the  simplex-transitioni  from  the  originating  state  in  STM(:,1).  Then  from 
Example  3.7,  the  symbols  assigned  to  all  the  transitions  originating  from  the 
originating  states  in  STM(:,2)  STM(:,3)  and  STM(:,4)will  be  fixed.  So  far,  all  the 
state  transitions  have  been  assigned  proper  symbols. 

For  HDCTCM(4,Z))with  D>3,  continue  the  above  symbols  assignment 
procedure.  At  each  step,  extend  the  symbol  assignment  procedure  to  a  new  dimension  of 
STM.  Consider  the  set  of  four  originating  states  in  the  same  internal  location  of  the  four 
butterflies  along  that  dimension.  There  is  one  originating  state  located  in  the  butterfly  at 
the  first  location  index  along  that  dimension.  From  the  previous  step,  the  symbols 
assigned  to  the  simplex-transitioni  from  this  originating  state  are  known;  then  from 
Example  3.7,  the  simplex-transitioni ’s  from  the  other  three  originating  states  will  be 
fixed.  In  this  way,  all  the  transitions  in  the  set  of  butterflies  along  that  dimension  will  be 
assigned  proper  symbols  at  that  step. 

For  a  particular  state  transition,  different  symbol  assignments  will  be  obtained  if 
we  start  the  symbol  assignment  procedure  from  a  different  butterfly  or  a  different 
originating  state  in  the  first  butterfly  in  STM,  or  if  we  change  the  order  of  assigning  the 
related  source  simplex  to  the  simplex-transitioni  from  the  first  originating  state.  Those 
resultant  symbol  assignments  can  also  be  obtained  by  using  the  symbol  assignment 
procedure  described  above  but  employing  different  STMs  built  by  choosing  different 
STM-FFREE  (first  butterfly)  (or  STM-FREE  (first  location))  and  different  STM-FREE 
(left  side  butterfly),  respectively.  In  our  symbol  assignment,  we  will  always  take  the  way 
we  did  in  this  example  and  leave  the  different  symbol  assignments  to  employing  different 
STM-FREEs. 

In  summary,  for  a  HDCTCM(4,Z))  system,  the  IIS  is  built  using  Procedure  3.4. 
The  signal  constellation  consists  of  all  the  source  simplexes  related  to  all  the  signals  in 
IIS.  Different  symbol  assignments  (different  codes)  for  HDCTCM(4,Z))  result  from 
applying  the  symbol  assignment  procedure  described  above  to  different  STMs  built  by 
choosing  different  STM-FREEs. 
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We  have  seen  that  there  is  one  to  one  mapping  between  eaeh  originating  state  in 
STM  and  the  symbols  in  IIS.  We  also  see  from  the  symbol  assignment  proeedure  that  for 
a  state  transition  in  STM,  knowing  its  loeation  in  STM  (the  loeation  of  the  butterfly 
containing  this  transition  and  the  internal  location  of  this  transition  in  this  butterfly),  the 
symbol  assigned  to  this  transition  will  be  known.  That  is  to  say,  there  is  also  a  one  to  one 
mapping  between  each  state  transition  and  each  symbol  in  the  signal  constellation. 

3.4  Uniformity  of  HDCTCM 

This  section  proves  that  HDCTCM  using  3-out-of-N  simplex  signaling  scheme  is 
uniform. 


3.4,1  Uniformity  in  coding 


In  coding  scheme,  the  set  of  pair-wise  squared  Euclidean  Distance  SED 


between  code  word  C.  and  Cj,  where  i,j  =1,2,...,  IE  and  IE  is  the  total  number  of  legal 
code  words,  can  be  arranged  into  a  IE  x  IE  matrix  E 

^12 

.  4  4 

E=  . 

Because  of  the  commutativity  of  SED,  =  d^...  The  matrix  is  a  symmetric  matrix  with 


r2 

\M 

a 

IM 


(3.3) 


all  diagonal  elements  being  zero.  If  the  matrix  E  has  such  a  symmetry  that  the  sum  of  all 
the  elements  in  any  row  (column)  of  E  does  not  depend  on  the  row  (column)  index,  then 
the  distance  distribution  calculation  can  be  greatly  simplified.  Such  symmetry 
corresponds  to  having  all  the  code  words  on  an  equal  footing  and  allows  the 
consideration  of  a  single  reference  code  word  rather  than  all  the  pairs  of  code  words  for 
computation  of  error  probabilities  and  distance  distribution.  Such  symmetry  is  called 
uniformity  [35]. 


3,4.2  Algebraic  Definition  of  Uniformity 

Denote  /  as  a  IE  x  1  column  vector  whose  elements  are  all  ones.  Eor  a 
IE  X  IE  square  matrix  O,  if  /  is  an  eigenvector  of  its  transpose  ,  then  1^0=  (l)f  holds. 
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where  (j)  is  the  eigenvalue  with  respeet  to  the  eigenvector  I .  Then,  the  sum  of  the 
elements  in  a  column  of  O  does  not  depend  on  the  column  index.  O  is  called  column- 
uniform  [35].  Similarly,  if  /  is  an  eigenvector  of  the  square  matrix  z,  then  zl  =  Ix  holds, 
where  x  is  the  corresponding  eigenvalue.  Then,  the  sum  of  the  elements  in  a  row  of  z 
does  not  depend  on  the  row  index,  z  is  called  row-uniform.  It  is  easy  to  prove  that  the 
product  or  the  sum  of  two  column-  (row-)  uniform  matrices  is  itself  column-  (row-) 
uniform  [35].  Also,  for  a  W  xW  matrix,  O ,  that  is  either  row-  or  column-  uniform,  we 
T 

have  I  01  =  Wcj) ,  where  is  a  constant. 


3,4,3  Conditions  for  Uniformity 

Assume  code  word  C,  can  be  expressed  as  a  vector  of  L  symbol  elements  as 
C-  =  [Qj,...,Q,...,C.^].  The  SED  between  C.  and  C.  is  equal  to  the  sum  of  the  SED 
between  the  corresponding  symbols. 


d\C„C,)  =  dl  =  Y,d\C,„C,)  =  Z4 

k=\  ^=1 

L 

Eet  E^=  =1,2,...,IF,  ic  =  1,2,... ,E  ,  then  E=Y^E^. 


(3.4) 


k=\ 


Since  E  and  E'j.are  symmetric,  row-  (column-)  uniform  implies  column-  (row-)  uniform. 
We  do  not  differentiate  them  later.  If  we  can  show  is  uniform  for  all  k ,  then  E  is 
uniform. 

Define  a  code  word  matrix  (CM)  containing  all  the  code  words  as 


CM  = 


C  C 

'-'11  '-'12 

c  c 

'-^21  '-^22 

c  c 


c, 


IL 


c 


'2L 


c„ 


(3.5) 


Denote  the  total  number  of  symbols  in  the  signal  constellation  as  TOT-SYM.  If  a  symbol 
assignment  method  guarantees  that  each  symbol  in  the  signal  constellation  is  used  equally 
often,  which  is  the  case  for  most  coding/modulation  scheme  such  as  HDCTCM,  then  in 
each  column  of  CM,  each  symbol  will  occur  W/  TOT-SYM  times.  is  the  SED 
between  the  and  symbols  in  column  k  of  CM,  then  in  each  row  (column)  of  E).  , 
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there  are  W  /  TOT  -  SYM  duplieate  terms  of  beeause  of  the  duplieate  appearanee  of 
eaeh  symbol.  The  sum  of  eaeh  row  (eolurnn)  of  is  equal  to  W  /  TOT  -  STMtimes  the 
sum  of  the  single  appearanee  of  the  duplieate  terms  that  row  (column). 

If  we  cross  out  the  duplicate  in  along  rows  and  columns  and  keep  the  first 
appearance  of  the  duplicate  terms  of  then  a  new  matrix  is  formed.  It  is  a 
TOT  -  SYM  X  TOT  -  SYM  pair-wise  SED  between  TOT-SYM  distinct  symbols. 
Obviously,  is  also  symmetric.  Because  the  sum  of  each  row  (column)  of  is  equal 
to  W !  TOT  -  SYM  times  that  of  G^,  if  the  sum  of  each  row  (column)  in  G^  is 
independent  of  row  (column)  index— i.e.,  G^  is  uniform— then  E^  is  uniform.  So,  the 
proof  of  the  uniformity  of  E^.  is  transferred  to  the  proof  of  the  uniformity  of  . 

3.4,4  Uniformity  of  HDCTCM 

For  all  k ,  the  sum  of  a  particular  row  (column)  in  G^  is  the  sum  of  SED  from  a 
particular  symbol  to  all  the  other  symbols  in  the  signal  constellation.  What  we  need  to 
prove  is  that  sum  does  not  depend  on  that  particular  symbol. 

In  HDCTCM  (4,D)usmg  3-out-of-N  simplex  signaling  scheme,  there  are  4^ 
symbols  in  IIS;  any  two  of  them  occupy  at  least  two  different  space  dimensions.  All  the 
source  simplexes  related  to  all  the  symbols  in  IIS  constitute  the  signal  constellation.  So, 
there  are  4^  source  simplexes  in  the  signal  constellation.  Any  two  source  simplexes 
occupy  at  least  two  different  space  dimensions.  Each  symbol  in  the  signal  constellation  is 
a  member  of  a  source  simplex. 

Pick  any  symbol  in  this  signal  constellation  as  the  reference  symbol.  Suppose  this 
reference  symbol  is  a  member  of  source  simplex  /.  All  the  other  symbols  can  be 
categorized  to  the  following  types: 

1.  Symbols  in  the  source  simplex  I .  They  are  the  other  three  member  signals  in  source 
simplex  / .  It  can  be  verified  that  in  an  even  or  odd  source  simplex,  the  SED  profile 
from  any  member  signal  to  the  other  three  member  signals  is  8/8/8. 

2.  Symbols  in  the  source  simplexes  other  than  source  simplex  /.  Those  simplexes  occupy 
at  least  two  different  dimensions  from  source  simplex  /.  According  to  the  different 
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dimensions  occupied  by  those  simplexes  from  that  occupied  by  source  simplex  /, 
these  source  simplexes  can  be  divided  into  two  sub-categories  here. 

2a.  The  number  of  different  dimensions  is  two.  Suppose  source  simplex  /  occupies 
dimensions  1,  2,  and  3.  Source  simplex  J  occupies  dimensions  1,  4,  and  5. 
Simplex  /  can  be  an  even  or  odd  source  simplex,  as  does  simplex  J .  There  are 
four  combinations  of  the  source  simplex  types  for  /  and  J .  They  are  (/  even,  J 
even),  (/even,  J  odd),  (/odd,  Jeven),  and  (/  odd,  Jodd).  Take  (/  even,  J  odd) 


(  \  2  3^ 

ri  4  -5^ 

as  an  example,  then  simplex  /  is 

1  -2  -3 

-1  2  -3 

,  simplex  J  is 

1  -4  5 

-1  4  5 

1-1  -2  3/ 

fin 

1 

1 

7 

The  SED  from  any  symbol  in  simplex  /  to  the  four  symbols  in  simplex  J  is 
4/4/8/8.  It  can  be  verified  that  for  any  of  these  four  combinations,  the  SED  profile 
from  any  symbol  in  simplex  /  to  the  four  symbols  in  simplex  J  is  4/4/8/8,  as  is 
the  SED  profile  from  any  symbol  in  simplex  J  to  the  four  symbols  in  simplex  / . 

2b.  The  number  of  different  dimensions  is  three.  Suppose  source  simplex  /  occupies 
dimensions  1,  2,  and  3.  Simplex  Joccupies  dimension  4,  5,  and  6.  In  each  of  the 
four  source  simplex  type  combinations,  the  SED  profile  from  any  symbol  in 
simplex  /  to  the  four  symbols  in  simplex  J  is  6/6/6/6,  as  is  the  SED  profile  from 
any  symbol  in  simplex  J  to  the  four  symbols  in  simplex  / . 

Erom  the  reference  symbol  to  all  the  other  symbols  in  the  signal  constellation,  the 
distance  profile  is  a  certain  number  of  the  distance  profiles  in  these  difference  categories. 
There  is  always  one  and  only  one  distance  profile  of  category  1 .  Suppose  the  number  of 
source  simplexes  in  category  2a  and  2b  are  and  «2  respectively,  then  l  +  n^+n^  =4^. 
If  from  any  symbol,  looking  at  all  the  other  symbols  in  the  signal  constellation,  there  are 
same  amount  of  and  «2  ?  then  the  SED  profile  from  any  symbols  is  the  same,  but  this  is 
not  necessary  because  all  we  want  is  the  sum  of  the  SED  profile  from  the  reference 
symbol.  Note  that  the  sum  of  the  distance  profile  in  each  category  is  the  same,  i.e., 
8  +  8  +  8=4+4  +  8  +  8  =  6  +  6+6  +  6  =  24  (3.6) 
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Therefore,  the  sum  of  the  SED  profile  from  the  reference  symbol  is 
l-(8+8+8)+ni  •(4+4  +  8  +  8)  +  n2  •(6  +  6  +  6+6)=24-(l+ni  +n2)=24-4'' 

(3.7) 

This  sum  does  not  depend  on  which  symbol  being  chosen  as  the  reference 
symbol.  We  have  proved  that  the  sum  of  SED  from  any  symbol  in  the  signal 
constellation  to  all  the  other  symbols  is  the  same;  i.e.,  the  sum  of  a  row  (column)  of  G^.  is 
the  same  regardless  the  row  (column)  index.  That  is,  is  uniform  for  all  k ,  and  then, 
E^.  is  uniform  for  all  k .  This  will  give  that  E  is  uniform. 

In  conclusion,  HDCTCM(4,  D)  using  3-out-of-N  simplex  signaling  scheme  is 
uniform. 
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CHAPTER  4  Computational  Algorithm  to  Calculate  the 
Minimum  Distance 


For  an  error  control  coding  scheme,  the  minimum  distance  among  all  the  code 
words  plays  an  important  role  in  determining  the  error  correcting  capacity  of  the  code. 
This  was  discussed  in  Section  3.1.  Computational  algorithms  [25]  [26]  [37]  were 
developed  to  obtain  the  minimum  distance  for  convolutional  codes.  The  assumption  made 
in  these  algorithms  is  the  known  starting  state  for  a  code  word.  This  assumption  is 
changed  in  the  circular  trellis  situation.  This  chapter  will  develop  a  new  algorithm  to 
calculate  the  minimum  distance  for  circular  trellis  coding.  Section  4.1  gives  the  general 
description  of  this  algorithm.  Sections  4.2  and  4.3  give  the  derivation  of  the  algorithm  in 
detail.  Section  4.4  analyzes  the  computational  complexity  of  this  algorithm.  Section  4.5 
shows  the  minimum  distance  structure  of  HDCTM  obtained  using  this  algorithm. 

4.1  General  Description  of  the  Algorithm 

Consider  a  circular  trellis  code  T{n,D),  as  defined  in  Section  2.2.  The  encoder 
can  be  implemented  using  tail  biting  or  circular  trellis  coding  with  permuted  state 
structure.  The  total  number  of  states  in  this  trellis  is  S  =  n^ .  For  information  sequence 
with  length  L  (having  L  k  -tuple  information  symbols  when  the  encoder  accept  k  -tuple 
inputs  at  one  time),  the  corresponding  code  sequence  is  a  trellis  path  with  C  stages.  There 
are  total  legal  paths  representing  all  the  code  words,  paths  for  each  possible 

starting  state.  A  T(2,2)  trellis  is  shown  in  Figure  4.1  with  the  paths  starting  from  a 
certain  state;  the  information  sequence  length  is  L  =  5. 
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- input  1 

-  input  0 

Figure  4.1  A  circular  trellis  T(2,2)  with  L  =  5 


For  a  coded  modulation  scheme,  a  branch  in  the  trellis  is  labeled  with  a  channel 
symbol  assigned  to  the  state  transition  represented  by  this  branch.  In  this  algorithm, 
distance  is  calculated  as  squared  Euclidean  distance  (ED).  Consider  the  uniform  circular 
trellis  codes.  This  kind  of  code  allows  consideration  of  a  single  reference  path  rather  than 
all  the  pairs  of  paths  for  computation  of  distance. 

Erom  one  path  in  a  circular  trellis,  look  at  all  the  other  paths;  they  can  be  divided 
into  two  categories: 

1 .  The  paths  having  the  same  starting  state  as  the  starting  state  of  this  path. 

2.  The  paths  having  different  starting  state  from  the  starting  state  of  this  path. 

We  are  going  to  develop  an  algorithm  with  two  parts  to  calculate  the  minimum 
distance  related  to  these  two  kinds  of  paths.  Part  I  (see  Section  4.2)  calculates  the 
minimum  distance  among  the  paths  that  have  a  same  starting  state  and  identifies  the  pair 
of  paths  having  this  minimum  distance  between  them.  Part  II  (see  Section  4.3)  calculates 
the  minimum  distance  between  a  path  and  all  the  other  paths  that  have  different  starting 
state.  Then  the  algorithm  to  calculate  the  minimum  distance  among  all  the  legal  paths  has 
the  following  steps: 

Algorithm:  calculate  the  minimum  distance  of  circular  trellis  T  {n,  D)  . 
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1.  Select  an  arbitrary  state  from  all  S  states.  Using  Algorithm  Part  I,  calculate  the 
minimum  distance  among  the  paths  having  this  state  as  starting  state  and  identify  a 
pair  of  paths  having  this  minimum  distance  between  them. 

2.  Select  either  path  from  the  identified  pair  of  paths  in  step  1.  Using  Algorithm  Part  II, 
calculate  the  minimum  distance  between  this  selected  path  and  all  the  other  paths  that 
have  different  starting  states  from  the  starting  state  of  this  selected  path. 

3.  From  the  selected  path  in  step  2,  the  minimum  distance  to  the  paths  in  the  first 
category  (defined  above)  has  been  obtained  from  step  1,  the  minimum  distance  to  the 
paths  in  the  second  category  has  been  obtained  from  step  2.  Therefore  the  smaller 
one  of  these  two  is  the  minimum  distance  from  the  selected  path  to  all  the  other  legal 
paths  in  this  trellis.  For  trellis  codes  with  uniformity,  it  is  the  minimum  distance 
among  all  the  legal  paths. 

4.2  Algorithm-Part  I:  Calculate  the  Minimum  Distance  Among  the  Paths  Having  a 
Same  Starting  State 

This  algorithm  is  inspired  by  the  application  of  Bellman’s  principle  of  optimality 
[24]  in  Viterbi  algorithm  and  in  the  computational  algorithm  for  calculating  the  free 
distance  for  convolutional  codes  [25]  [37].  Bellman’s  principle  of  optimality  is 
introduced  in  this  section,  followed  by  the  derivation  of  the  algorithm. 

4.2,1  The  Principle  of  Optimality 

Denote  this  starting  state  as  start  state.  Name  the  summation  of  the  distance  of  a 
trellis  path  at  each  stage  up  to  stage  i  as  the  partial  distance  at  stages  i ,  where  \  <i  <  L. 

Bellman’s  principle  of  optimality  pertains  to  a  sequential  decision  problem  whose 
global  objective  function  is  an  additive  function  of  costs  of  transitions  between 
intermediate  stages.  The  basic  idea  is  that  the  global  optimal  path  must  be  an  extension  of 
an  optimal  path  to  some  state  at  an  intermediate  stage  i ,  and  this  must  hold  for  all  stage 
indexes  i.  Here  our  globally  optimal  objective  is  a  pair  of  paths  having  minimum 
distance  between  them  among  all  the  paths  having  start  state  as  their  starting  state.  By 
applying  Bellman’s  principle  of  optimality  to  a  pair  of  paths,  we  claim  that  they  must  be 
the  pair  of  paths  that  have  minimum  partial  distance  between  them  at  stage  i ,  among  all 


72 


pairs  of  paths  starting  from  start  state  and  reaching  the  same  states  as  those  reached  by 
the  globally  optimal  pair  of  paths  at  stage  i.  This  holds  for  all  i.  The  proof  is  by 
contradiction.  Suppose  the  globally  optimal  pair  of  paths  reach  states  p  and  q  at  stage  j ; 
if  there  is  a  second  pair  of  paths  reaching  states  p  and  q  having  less  partial  distance 
between  them  at  this  stage,  then  by  replacing  the  segment  of  the  global  optimal  pair  of 
paths  by  the  segments  on  the  second  pair  of  paths  up  to  this  stage,  a  new  pair  of  paths  is 
built  which  have  less  distance  between  them  than  that  of  the  /globally  optimal  pair  of 
paths.  This  contradicts  with  the  definition  of  the  globally  optimal  paths. 

Denote  the  minimum  partial  distance  between  all  pairs  of  paths  starting  from 
start  state  and  reaching  states  p  and  q  at  stage  /  as  p ,  q  can  be  any  of  the  total 

states.  The  history  of  the  pair  of  paths  having  distance  between  them  is  stored  in 
It  is  a  string  consisting  of  sequences  of  information  symbols  causing  the  state 

transitions  on  this  pair  of  paths  until  stage  / . 

The  argument  above  says,  at  each  stage,  for  each  pair  of  states  p  and  q ,  all  but 
one  pair  of  paths  having  distance  ^  can  be  pruned  away.  Until  the  last  stage  L ,  the  pair 
of  paths  kept  for  state  pair  p ,  q  with  p  =  q  =  start  _state  is  the  globally  optimum  pair  of 
paths  we  seek. 


4,2,2  Derivation  of  Algorithm-Part  I 

Let  us  show  how  to  update  those  S  and  X.  In  general,  there  are  n  states  from 
which  a  one-stage  transition  to  state  p  is  possible;  call  these  states  the  predecessors  of  p 
denoted  as  .  In  the  case  of  parallel  transitions,  p,  ^  p,  for  all  /denotes  all 

the  n  transitions  that  are  caused  by  the  n  possible  A: -tuple  information  symbols.  So  in 
general,  there  are  a  total  of  pairs  of  paths  reaching  states  p  and  q  at  stage  /  and  they 
pass  through  the  state  pair  {pi,  p„),  l,m=\,...,n  at  stage  z-l.  Then  the  minimum 


partial  distance  between  all  pairs  of  these  paths  is 


(4.1) 


The  distances  S‘  '  come  from  previous  stage,  d^(Pi  p,q^  -^q)is  the  squared 


Euclidean  distance  between  the  two  channel  symbols  associated  with  the  transitions 
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Pi^pand  q„^q.  Suppose  the  minimum  value  is  {p^  ^  p,qf^  ^  p)  in 

Equation  (4.1)  (whenever  there  is  a  tie,  arbitrary  ehoiee  applies);  then/l'^^is  updated  by 
appending  the  A: -tuple  information  symbols  causing  the  state  transitions  denoted  as 
u{Pg  ^;?)and  u{q^  -^q),  to  ;  i.e., 

MPg  p)Mqk  d))  (4-2) 

Due  to  the  pair-wise  symmetry  for  distance,  we  only  need  to  consider  state  pair  {p,q) 
with  q>  p. 

5  is  initialized  as 
„  f  0,  q  =  p  =  start  state 

^  “  (4.3) 

P’‘‘  (go,  p  start _state,q  >  p 

When  <5^  ^  =  GO ,  there  is  no  pair  of  paths  reaching  states  p  and  q  at  stage  i .  All  /l°  ^  are 
set  as  null  sequence. 

From  start_state,  D  stages  state  transitions  are  needed  to  reach  all  the  states. 
For  the  first  D-\  stages,  at  each  stage  the  states  that  can  be  reached  from  start_state  is  a 
subset  of  the  total  states  in  this  trellis.  We  only  need  to  update  <5^  ^  and  /l'^  ^  where  p  and 
q  belong  to  those  reached  states.  There  is  no  pair  of  paths  that  can  reach  states  p  and  q , 
where  p  and  q  belong  to  those  states  that  cannot  be  reached  at  these  stages;  i.e.,  <5^^^ is 
always  go  and  ^  is  always  a  null  sequence  for  those  p  and  q  .  At  stage  D  or  later,  all 
the  states  can  be  reached,  so  (5^  ^  and  X^  ^  ,  where  p  and  q  belong  to  all  the  states,  need 
to  be  updated . 

Unfortunately,  this  will  not  select  the  pair  of  paths  we  want.  Fet  us  see  what  we 
will  get  going  through  the  trellis.  Initially,  ^stan_state,stan_state  =  0-  At  stage  1,  for  any  state 
p  that  can  be  reached  at  this  stage,  the  term 
€an_state,s,an_s,ate  +  d\start _start  ^  p, Start _start  ^  ;?)  =  0  +  0  =  Oin  Equation  (4.1)  will 
give  Sp  p  =  0 .  This  means  the  pair  of  paths  having  minimum  partial  distance  between 
them— among  all  the  pair  of  paths  starting  from  start  state  and  reaching  state  p  —have  the 
same  route  till  this  stage.  At  stage  2,  for  any  state  p  that  can  be  reached,  the  term 
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Ki  Pi  ■*"  ^  P’Pi  P)  Equation  (4.1)  is  equal  to  0+0  =  0,  where  Pi  is  one  of  the 

reaehed  states  in  stage  1 .  This  leads  to  ^  =  0 .  Continuingly  in  this  way,  we  will  get 
Sp  p  =  0  for  any  state  p  that  can  be  reached  at  stage  i  from  start_state.  When  i>  D,  all 
the  total  states  can  be  reached;  i.e.,  for  any  state  p  of  the  total  states,  (5^  ^  =  0 .  Finally, 

K  state,s  state  =  ^  i  t^c  minimum  distance  among  all  the  paths  starting  from  start_state 
is  0  .  The  pair  of  paths  having  this  minimum  distance  between  them  have  the  same  route. 
It  is  one  path  that  is  regarded  as  a  pair  of  paths.  This  happens,  because  when  we  derive 
Equation  (4.1),  we  assume  that  a  pair  of  paths  contains  two  different  paths.  For  the  pair  of 
states  p  and  q  with  p^  q ,  the  two  paths  reaching  different  states  are  always  two 
different  paths.  However,  for  p=q  there  is  no  restriction  regarding  one  path  as  a  pair  of 
paths  reaching  state  p  and  q  with  p=q  at  each  stage  in  Equation  (4.1),  and  that  leads  to 
the  result  aforementioned.  We  must  put  some  conditions  on  updating  (5^  ^  with  p=q  to 
eliminate  this  problem. 

Consider  how  all  the  paths  are  built  in  this  trellis.  (See  Figure  4.1.)  From 
start  state,  it  branches  out  n  branches  at  stage  1,  forming  n  different  paths.  Then  each  of 
the  reached  states  at  stage  1  branches  out  n  branches  at  stage  2,  forming  different 
paths.  In  this  way,  each  of  the  reached  states  at  each  stage  will  branch  out  n  branches  at 
the  next  stage,  forming  n  times  more  different  paths.  So,  at  stage  L-D-\, 
different  paths  will  be  formed,  and  each  of  the  reached  state  at  this  stage  will 
branch  out  n  branches  at  stage  L-D,  forming  the  entire  different  paths.  From 
stage  L-D  until  L ,  at  each  stage  the  reached  state  will  not  branch  out  to  form  new 
different  paths  but  will  have  only  one  state  transition  to  the  next  stage.  Consequently,  at 
each  stage  i,  among  all  the  pairs  of  paths  both  reaching  state  p,  where 
\<i  <L-D-  land  p  is  any  of  the  reached  states  in  stage  i,  there  is  always  a  pair  of 
paths  having  the  same  route  till  this  stage.  We  know  they  are  different  paths,  because  all 
reached  states  will  always  branch  out  at  the  next  stage;  then,  two  paths  having  the  same 
route  till  this  stage  will  always  have  different  route  paths  later.  This  pair  of  paths  is 
represented  by  the  term  +  (f{pi  p,Pi  p),  where  =  0,  in  Equation  (4.1). 
But  at  each  stage  i ,  where  L  -  D<i  <  L,  among  all  the  pairs  of  paths  both  reaching  state 
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p  where  p  is  any  of  the  reaehed  states  in  stage  i,  there  is  no  pair  of  paths  having  the 
same  route  till  this  stage.  Since  each  reached  state  at  this  stage  will  have  only  one  state 
transition  to  the  next  stage,  if  they  have  the  same  route  till  stage  i,  they  will  have  the 
same  route  afterwards,  and  they  will  just  be  the  same  path.  So,  all  pairs  of  paths  both 
reaching  p  at  stage  i  must  have  different  partial  paths  until  this  stage.  They  must  either 
pass  through  different  states  at  stage  i  - 1  or,  if  they  pass  through  the  same  state  at  stage 
/  - 1 ,  the  distance  between  them  should  be  nonzero  at  that  stage.  This  means  the  term 
+  cf'ipi  p,Pi  p)  in  Equation  (4.1),  where  =  0,  does  not  correspond  to  a 
pair  of  different  paths,  and  it  should  be  eliminated.  The  correct  updating  equation  for 
(5^  ^ ,  where  p=q,  will  be 

+d^(Pi^  P,  (Jn.  Pi  *  (In,  or  if  Pi  =  q^,  ^  0  }  (4.4) 

Using  this  equation  at  stage  L-  D  will  give  ^  0  for  all  states  p  that  can  be 
reached  at  this  stage,  and  will  give  5'f^  =  go  for  those  p  that  cannot  be  reached.  Then  at 
stage  L  -  D  +  \,  when  updating  there  will  be  no  such  term  as 

K'i!p,  (^^^Pi  P’Pi  P)  ~  0  eliminated.  As  a  result.  Equation 

(4.3)  becomes  Equation  (4.1).  So  do  later  stages  until  stage  L.  In  summary,  the  updating 
equation  for  <5^ ^  with  p=q,\s  Equation  (4.1),  when  zV  L  -  D,  and  Equation  (4.4),  when 
i  =  L-D. 

4.2,3  Basic  Steps  for  Algorithm-Part  I 

Now,  we  can  give  the  basic  steps  for  Algorithm— Part  I; 

1.  Initialize  (5°  using  Equation  (4.1).  All  are  initialized  as  null  sequences. 

2.  Eor  each  stage  i  ,  where  1  <  z  <  E,  for  any  pair  of  states  p  and  q  with  q>  p,  p  and 
q  both  belong  to  the  states  that  can  be  reached  from  start_state  at  this  stage 

p^  q,  update  <5^  ^  using  Equation  (4.1), 

else,  if  zV  E  -  Z) ,  update  ^using  Equation  (4. 1),  if  z  =  E  -  E) ,  using  Equation  (4.4). 

In  either  case,  update  /l'^  ^  accordingly  using  Equation  (4.2). 
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3-  Ktan_state,stan_state  thc  miiiimum  distancc  among  all  the  paths  having  start_state  as 
starting  state  and  ending  states  and  stores  the  pair  of  paths  having 

this  minimum  distance  between  them. 

4,3  Algorithm-Part  II:  Calculate  the  Minimum  Distance  Between  a  Path  and  All 
the  Paths  Having  Different  Starting  State  from  the  Starting  State  of  This  Path 

Denote  this  particular  path  as  base_path,  and  its  starting  state  as  base_state. 

As  shown  in  Section  2.4,  Viterbi  algorithm  finds  the  path  having  the  minimum 
distance  to  the  received  sequence.  The  Viterbi  algorithm  works  for  a  trellis  in  which  all 
the  paths  have  the  same  stating  state  and  ending  state  known  a  priori.  Using  Viterbi 
algorithm  in  circular  trellis  codes  T{n,D)  is  to  run  Viterbi  algorithm  a  total  of  times— 
one  run  for  each  possible  starting  state.  Regarding  the  base_path  as  the  received 
sequence,  each  Viterbi  run  will  yield  the  path  having  the  minimum  distance  to  the 
base_path,  among  all  the  paths  having  a  certain  starting  state  and  the  same  ending  state. 
The  Viterbi  run  for  base  state  will  always  find  the  base_path  with  distance  zero  because 
the  base_path  is,  in  fact,  a  legal  path  among  all  the  paths  having  base  state  as  starting  and 
ending  state.  For  our  purpose,  we  do  not  need  that  since  we  already  solved  the  problem  of 
finding  the  minimum  distance  among  all  the  paths  having  a  same  starting  state  in 
Algorithm— Part  I.  The  other  - 1  Viterbi  runs  give  the  minimum  distance  between  the 
base_path  and  the  paths  having  different  starting  state  from  base  state.  That  is  what  we 
want. 

So,  we  have  the  following  steps  for  Algorithm— Part  II: 

1.  Regard  the  base_path  as  the  received  sequence.  For  each  of  the  states  other  than 
base  state,  denoted  as  a.,  where  I  <  j  <n°  -  \,  run  Viterbi  algorithm  on  the  trellis 
having  Sj  as  starting  state  and  ending  state.  We  will  get  the  minimum  distance 
between  the  base_path  and  the  paths  having  a.  as  starting  state  and  ending  state 
denoted  as  d  . . 

2.  min(  J  ) ,  j  =  1,  ...,n^  - 1 ,  is  the  minimum  distance  between  the  base_path  and  all  the 

./ 

having  different  starting  and  ending  state  from  base_state. 
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The  Viterbi  algorithm  for  s.  is  stated  here.  Denote  the  minimum  partial  distanee 
between  the  base_path  and  all  the  paths  entering  state  p  at  stage  i  as  A'^ ,  p  is  any  of  the 
states  that  ean  be  reaehed  from  Sj  at  this  stage.  We  do  not  need  to  store  the  path  history 
for  our  purpose.  In  general,  there  are  n  paths  entering  p  at  stage  i ,  they  pass  through  pj 
at  stage  /  - 1 ,  where  p,  is  one  of  the  predeeessors  of  state  p  .  The  updating  equation  for 


A''  is 


A'  =  min{A  '  +d^(pi  p,  state  transion  on  base _path  ),l=\,...,n} 


(4.5) 


where  d^(p,  ^  p, state  transion  on  base jyath)  is  the  squared  Euelidean  distanee 
between  the  two  ehannel  symbols  assoeiated  with  the  state  transition  Pi  ^  p  and  the 
state  transition  on  the  base_path  from  stage  i-\  to  stage  i  . 

The  Viterbi  run  for  state  Sj  has  the  following  steps: 


1.  SetA';  = 


0, 


00. 


p=Sj 

otherwise ' 


(4.6) 


2.  At  eaeh  stage  i,  where  1  <  /  <  T,  for  eaeh  of  the  state  p  that  ean  be  reaehed  at  this 
stage,  update  A'^ using  Equation  (4.5). 

3.  A^  is  the  minimum  distanee  between  the  base_path  and  all  the  paths  having  a.  as 
starting  and  ending  state. 


4,4  Computation  Complexity  of  the  Algorithm 

This  seetion  analyzes  the  eomputation  eomplexity  of  the  algorithm.  Ways  to 
reduee  the  eomputation  load  are  also  given. 


4,4,1  Analyze  the  Computation  Complexity  of  the  Algorithm 

In  Algorithm— Part  I,  for  a  pair  of  states  p  and  q  eaeh  updating  using  Equations 
(4.1)  and  (4.4)  involves  the  add-eompare-seleet  operations.  Regard  these  operations  as  a 
basie  operation.  At  eaeh  stage,  at  most  (5*^  +  5)  /  2  state  pairs  need  to  be  updated,  when 
p  and  q  ean  be  any  of  the  total  states  and  q>  p.  Therefore,  the  total  number  of 
operations  needed  is  upper  bounded  by  (5*^  +  5)  /  2  •  E .  It  is  linear  on  the  seeond  order  of 
total  state  number  S  and  the  information  sequenee  length  L .  In  Algorithm— Part  II,  for  a 
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state  p ,  regard  the  add-compare-select  operations  in  each  updating  using  Equation  (4.5) 
as  a  basic  operation;  the  total  number  of  operations  needed  is  upper  bounded  by  5*  •  E .  It 
is  linear  on  the  first  order  of  total  number  of  states  S'.  For  the  entire  algorithm,  the  total 
number  of  operations  is  upper  bounded  by  {S^  +  3S) 1 2  -  L,  although  different 
computation  loads  may  be  involved  in  the  basic  operations  for  part  I  and  part  II.  In 
practical  implementation,  the  terms  {pj  p,q^  -^q)m  Equations  (4.1)  and  (4.4)  can 
be  calculated  only  once  and  stored  in  a  table,  for  all  p ,  q ,  and  Pi,q^.  So  can  the  terms 
(/>,  ^  j!7,state  transion  on  ref_path  )  in  Equation  (4.5).  Eater,  for  each  stage  the 
terms  can  be  retrieved  through  quick  table  lookups.  Then  if  we  only  consider  the 
additions  as  the  computation  load  in  each  basic  operator,  the  total  number  of  computation 
is  upper  bounded  by  {S^  +  S)l  2- L-n^  +S- L-n.  The  path  memory  needed  for  this 
algorithm  is  (S^  +  S)/  2  -2  logj  n  ■  Tbits. 

4.4.2  Computation  Reduction 

Still  some  computation  reduction  can  be  done.  For  Algorithm— Part  I,  our  goal  is 
to  get  at  stage  L.  From  Equation  (4.1),  only  ^^"''‘jrom  the  previous 

stage  are  needed,  where  pj  and  q^  belong  to  the  predecessors  of  state  start  state.  In  order 
to  get  these  (5^"' ,  only  the  of  pair  of  states  p  and  q  are  needed,  where  p  and  q 
both  belong  to  the  predecessors  of  and  q^ .  p  and  q  are  the  second  level  predecessors 
of  start  state,  i.e.,  the  states  from  which  a  two-stage  state  transition  to  start  state  is 
possible.  The  4  level  predecessors  of  start_state  are  all  the  states  from  which  an  i  -stage 
state  transition  to  start  state  is  possible.  In  general  there  are  n  states.  TheT),;,level 
predecessors  are  the  total  S  states  in  this  trellis.  At  stage  i,  only  S  of  pair  of  states  both 
belonging  to  the  predecessors  of  start  state  needs  to  be  calculated 

(0,, predecessor  is  start_state  itself)  to  get  When  L-i<D;  i.e., 

i>  L  -D,  the  predecessors  are  a  subset  of  the  set  of  total  states,  so,  for  each 

stage  i  where  T  -  D  +  \<i<  L  ,  only  S  of  a  reduced  number  of  pairs  of  states  needs  to  be 
updated.  The  same  is  true  for  updating/l'.  Also,  we  have  seen  for  stage  i<E-D,  there  is 
always  a  pair  of  paths  both  reaching  states  p  and  having  the  same  route  until  this  stage. 
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That  is  to  say,  (5^  ^  =  0 ,  for  any  state  p  that  can  be  reached  at  this  stage.  Equation  (4.1) 
will  always  give  0  if  one  actually  calculates  it.  The  updating  of  ^  for  these  p  is  in 
Equation  (4.3),  where  p^  =  ^^and  p^  is  any  one  of  the  predecessors  of  p  and  was 
reached  at  stage  /  - 1 . 

The  revised  version  of  Algorithm— Part  1  to  reflect  these  reductions  is: 

E  Initialize  as  before. 

2.  Eor  each  stage  i ,  where  1  <  /  <  E ,  get  the  set  of  states  that  will  be  considered. 

If  z  >  E  -  E)  +  1,  the  set  of  states  considered  is  the  (E  -  z),^  predecessors  of  start  state, 
else  if  i<  D,  it  is  the  set  of  all  the  states  that  can  be  reached  by  a  z -stage  state 
transition  from  start  state. 
else  it  is  the  set  of  the  total  S  states 

Then  for  each  pair  of  states  p  and  q  with  q>  p,  p  and  q  both  belong  to  the  set  of 
states  considered, 

p^  q,  update  (5^^  using  Equation  (4.1), 
else  { 

if  z  <  E  -  E),  set(5^^  =  0, 

else  if  z  =  E  -  E) ,  update  ^using  Equation  (4.4)  , 
else  update  ^using  Equation  (4.1) 

} 

In  each  of  these  cases,  update  X^  ^  accordingly  using  Equation  (4.2). 

3.  Same  as  before. 

The  reduction  of  the  computation  for  the  last  D  stages  is  also  applied  for 
Algorithm— Part  II.  Then  for  each  stage  z,  where  E  -  E)-l- 1  <  z  <  E,  only  A'^,  where  p 
belongs  to  the  (E  - predecessors  of  base  state,  needs  to  be  updated.  The  revision  of  it 
is  obvious. 

4,5  Minimum  Distance  of  HDCTCM 

Apply  this  algorithm  to  HDCTCM  (4,D).  Denote  the  minimum  distance  obtained 
from  step  1  in  Algorithm  (Section  4.1)  as  min  diSp  the  one  obtained  from  step  2  as 
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min  diSj ,  the  minimum  distance  of  this  code  is  minimin  t/wpmin  t/wj}.  For  each  D, 
Z)  =  2,3,4,5,  for  all  different  codes  (different  STM-FREE),  min  diSj  and  min  diSj  are 
calculated  at  different  information  length  L.  In  Figure  4.2  to  4.5,  the  min_diSj(min_dis2 ) 
versus  L  is  plotted  for  some  for  some  different  codes  for  each  D,  Z)  =  2,3,4,5.  Distance 
is  calculated  as  squared  ED,  signal  has  unit  plus  in  each  of  the  three  dimensions  it 
occupies,  out  of  the  total  dimensions  of  the  signal  space. 


L(Symbols  Per  Information  Sequence)  L(Symbols  Per  Information  Sequence) 
Figure  4.2  Minimum  distance  of  HDCTCM(4,2) 
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Figure  4.3  Minimum  distance  of  HDCTCM(4,3) 
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Figure  4.4  Minimum  distance  of  HDCTCM(4,4) 
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Figure  4.5  Minimum  distance  of  HDCTCM(4,5) 


For  all  the  cases  calculated,  the  following  trend  is  observed.  For  min  diSj,  when 
L  =  Z)  + 1 ,  it  is  8  •  (Z)  + 1) .  This  verifies  the  correctness  of  this  algorithm.  At  L  =  D  +  \, 
the  state  transitions  on  the  n  paths  related  to  a  certain  starting  state  at  each  stage  are 
assigned  symbols  that  construct  simplex;  this  is  how  we  build  the  codes.  The  distance 
between  simplex  signals  is  8,  so  the  distance  between  these  paths  is  8-(Z)  +  l).  At 
L=D  +  2,  min  diSj  is  another  value  that  can  be  different  from  8-(Z)  +  l).  For 
Z.  >  Z)  +  2,  it  keeps  the  same  value  as  the  value  at  L  =  D  +  2 . 

For  min  diSj ,  it  increases  when  L  increases  from  the  smallest  value  D+1  and 
eventually  reaches  the  value  same  as  min  diSj  at  L  =  D  +  2.  This  happens  when 
Lx2D  +  {0~2),  where  0~  2 denotes  an  integer  between  0  and  2.  For  larger  L, 
min  diSj  remains  at  this  value. 

In  practical  implementation,  L  >2D  +  (0  ~2).  Therefore,  for  FIDCTCM(4,Z)) 
with  a  given  D  and  L  >2D  +  {0  ~2),  the  minimum  distance  for  a  code  is  equal  to 
min  diSjat  L=D  +  2.  From  these  figures,  different  codes  (corresponding  to  different 
STM-FREE)  of  HDCTCM(4,Z))for  a  given  Dean  give  different  values  for  min  diSj  at 
L  =  D  +  2  .  But  a  tight  upper  and  lower  bounds  on  this  value— the  minimum  distance  of 
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HDCTCM(4,Z))— exist.  The  validity  of  this  elaim  will  be  proved  in  the  following 
chapter. 
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CHAPTER  5  BOUNDS  ON  THE  MINIMUM  DISTANCE  OF 
HDCTCM  AND  OPTIMUM  DISTANCE  CODE 


One  central  problem  of  coding  theory  has  been  the  seeking  of  codes  with  large  (or 
largest)  minimum  distance  for  a  given  code  parameters  [24],  For  most  coding  schemes, 
the  optimum  distance  codes  are  found  only  by  exhaustive  search  of  all  the  possible  cases. 
For  a  code  with  a  given  code  parameter,  if  there  are  a  large  number  of  codes,  exhaustive 
search  is  forbidden  and  an  upper  and  lower  bounds  on  the  minimum  distance  is  desired  to 
evaluate  the  error  correcting  capacity  of  this  code.  In  this  chapter,  an  upper  and  lower 
bounds  on  the  minimum  distance  of  practical  HDCTCM  (4,Z))  codes  are  derived  in 
Section  5.1.  Section  5.2  proves  that  the  bounds  can  be  reached.  Moreover,  Section  5.3 
designs  a  procedure  other  than  the  exhaustive  search  method  to  obtain  the  optimum 
distance  code  for  HDCTCM  (4,  D). 

5,1  Bounds  on  the  Minimum  Distance  of  HDCTCM 

The  last  chapter  shows  that  for  a  given  trellis  depth  D ,  the  minimum  distance  of  a 
HDCTCM (4, D)  code  with  information  sequence  length  L,  where  T  >2D  +  (0  ~2)and 
0  ~  2  denotes  an  integer  between  0  and  2,  is  equal  to  the  minimum  distance  among  the 
paths  associated  to  a  certain  starting  state  at  L  =  D  +  2.  For  a  given  D,  the  signal 
constellation  for  HDCTM(4,D)  codes  is  fixed;  different  codes  correspond  to  mapping 
the  signal  constellation  to  different  STMs  built  by  taking  different  STM-FREEs.  From 
Figures  4.2  to  4.5,  different  codes  will  give  different  minimum  distances.  Bounds  on  the 
minimum  distance  of  practical  HDCTCM  (4,D)  codes  for  a  given  D  are  derived  in  this 
section. 
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5.1.1  Distance  Structure  of  Signal  Constellation 

In  this  chapter,  all  distances  refer  to  the  squared  Euclidean  distances  (SED).  Erom 
building  IIS  in  Chapter  3,  we  can  see  that  for  two  symbols  in  IIS,  if  they  are  related  by 
“copy”  rule,  they  will  occupy  the  same  space  dimension  for  one  pulse-location  and 
occupy  different  space  dimensions  for  the  other  two  pulse-locations.  If  they  are  not 
related  by  “copy”  rule,  they  will  occupy  different  space  dimensions  for  all  three  pulse- 
locations.  All  source  simplexes  related  to  all  the  symbols  in  IIS  constitute  the  signal 
constellation.  It  can  be  verified  that  the  distance  between  any  two  member  signals  in  a 
source  simplex  or  a  type  B  simplex  is  8.  So,  any  two  symbols  in  the  signal  constellation 
can  be  members  of  a  source  simplex,  and  then  the  distance  between  them  is  8.  Or  they 
can  come  from  two  different  source  simplexes;  then  they  will  occupy  at  least  two 
different  dimensions  for  two  pulse-locations.  Eor  the  other  pulse-location,  they  can  be  the 
same  absolute  value  with  opposite  sign,  the  same  absolute  value  with  same  sign,  or 
different  absolute  value.  Eor  the  first  case,  these  two  symbol  are  members  of  a  type  B 
simplex,  then  the  distance  between  them  is  8;  for  the  second  case,  such  as  signal  (1,  3,  5) 
and  signal  (1,-2,  -4),  the  distance  between  them  is  4;  for  the  third  case,  such  as  signal  (1, 
3,  5)  and  signal  (2,  4,  6),  the  distance  between  them  is  6. 

Each  of  all  the  states  in  HDCTCM(4,Z))  is  related  to  a  unique  symbol  in  IIS.  The 
source  simplex  related  to  this  symbol  is  assigned  to  the  state  transitions  originating  from 
this  state.  So,  the  symbols  assigned  to  state  transitions  originating  from  different  states 
are  drawn  from  different  source  simplexes.  Therefore,  these  symbols  occupy  at  least  two 
different  dimensions  for  two  pulse-locations.  A  simplex-transitioni  is  assigned  a  source 
simplex.  A  simplex-transitioui,  2  <  /  <  Z)  + 1,  is  assigned  a  type  B  simplex. 

5.1.2  Path  Groups 

Eor  HDCTCM  (4,Z))  with  L  =  D  +  2,  there  are  4^  =16  paths  related  to  each 
possible  starting  state.  (See  Eigure  5.1.)  These  paths  can  be  divided  into  four  groups  and 
each  group  has  four  paths,  which  have  a  same  state  transition  at  stage  1 .  Denote  each  of 
these  groups  as  an  initial-group.  These  paths  can  be  divided  into  four  other  groups  at  the 
same  time,  and  each  group  has  four  paths  which  have  the  same  state  transition  at  stage 
D  +  2  .  Denote  each  of  these  groups  as  a  terminal-group.  Erom  stage  2  till  stage  D,  each 
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path  reaches  different  states.  At  stage  Z)  +  1 ,  the  four  paths  in  a  terminal-group  will  reach 
one  of  the  four  states  that  can  transit  to  the  ending  state,  which  is  the  same  as  the  starting 
state  at  stage  Z)  +  2 .  Each  of  the  four  paths  in  a  terminal-group  belongs  to  a  different 
initial-group  and  vice  visa.  Number  these  paths  using  integers  from  1  to  16  according  to 
the  following  principle;  each  initial-group  is  given  the  four  consecutive  numbers 
{4  •  m  + 1,  ....,  4  -(m  + 1)}  ,  m  =  0,  1,  2,  3 ,  and  each  terminal-group  is  given  an  arithmetic 
progression  sequence  with  an  increment  of  4,  {/,  /-l-4,  /  -l- 4 -2,  /-l- 4 -3},  /=  1,  2,  3,  4. 
(See  Figure  5.1.)  By  this  numbering,  each  path  in  an  initial-group  belongs  to  a  different 
terminal-group  and  vice  visa.  The  path  number  will  identify  the  state  transition  on  this 
path  at  each  stage  as  well  as  the  butterfly  containing  this  state  transition.  Therefore,  we 
will  simply  express  “the  state  transition  on  a  path  at  a  certain  stage”  as  “a  path  at  a 
certain  stage”.  Similarly,  express  “the  state  transitions  on  the  four  paths  in  a  group  at  a 
certain  stage”  as  “the  state  transitions  in  a  group  at  a  certain  stage”  or  just  as  “a  group  at 
a  certain  stage”. 

stage  1  2  3  ...  D+1  D+2 


Figure  5.1  The  16  paths  related  to  a  certain  starting  state  for  HDCTCM(4,Z))  at 

L=D  +  2 

Comparing  the  4  transitions  in  a  group  at  each  stage  with  the  sets  of  4  transitions 
constituting  simplex-transitions,  the  following  pattern  is  observed: 

For  the  4  transitions  in  an  initial-group;  At  stage  1,  they  are  the  same  from  definition.  At 
stage  2,  they  have  a  same  originating  state;  i.e.,  they  constitute  a  simplex-transitioni.  At 
stage  i ,  where  3  <  /  <  Z)  + 1 ,  they  are  one  set  of  4  transitions  constituting  simplex- 
transitioni.  i.  At  stage  D  +  2,  they  have  a  same  next  state;  i.e.,  they  constitute  a  simplex- 
transitiouD+i. 
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For  the  4  transitions  in  a  terminal-group:  At  stage  1,  they  have  a  same  originating  state; 
i.e.,  they  constitute  a  simplex-transitioni.  At  stage  i,  where  2<i  <  D,  they  are  one  set  of 
4  transitions  constituting  simplex-transitioni.  At  stage  Z)  + 1 ,  they  have  a  same  next  state; 
i.e.,  they  constitute  a  simplex-transitiouD+i.  At  stage  D  +  2,  they  are  the  same  from 
definition. 

5,1,3  Distance  Property  of  the  Paths 

The  distance  of  a  path  always  refers  to  the  distance  between  this  path  and  a 
reference  path.  The  distance  of  a  path  at  a  certain  stage  is  the  distance  between  the 
symbols  assigned  to  the  state  transitions  at  this  stage  on  this  path  and  the  reference  path. 
The  distance  of  a  path  is  the  summations  of  its  distances  at  all  stages. 

Recall  that  all  the  state  transitions  are  recorded  in  STM,  a  Z)  - 1  dimensional 
matrix.  The  unit  element  in  STM  is  a  butterfly  with  an  internal  order.  A  simplex- 
transitioni  or  a  simplex-transitiono+i  is  within  a  butterfly.  A  simplex-transitioni^  where 
2  <  /  <  Z) ,  is  the  set  of  the  4  transitions  in  the  same  internal  locations  of  the  4  butterflies 
along  the  (i-1),/,  dimension  of  STM.  Each  of  the  originating  states  g  in  STM  is  related 
to  a  symbol  s  in  IIS  that  has  the  same  location  as  the  location  of  state  g  in  STM.  The 
source  simplex  related  to  symbol  s  is  assigned  to  the  transitions  orientating  from  state  g . 
Knowing  the  state  transition’s  location  in  STM,  the  symbol  from  the  signal  constellation 
assigned  to  this  transition  will  be  uniquely  known.  So,  these  16  paths  can  be  depicted  in 
STM  stage  by  stage,  and  the  symbols  assigned  to  these  paths  at  each  stage  will  be  known. 
Then  the  distances  of  these  paths  at  each  stage  can  be  analyzed. 

Pick  any  of  these  16  paths  as  the  reference  path,  denoted  as  reference-path.  Then 
the  initial-group  and  terminal-group  containing  the  reference  path  are  known,  denoted  as 
reference-initial-group  and  reference-terminal-group,  respectively.  Denote  the  symbol 
assigned  to  the  reference-path  at  a  certain  stage  as  reference-symbol.  Among  the  15  paths 
other  than  the  reference-path,  there  are  3  paths  in  the  reference-initial-group,  denoted  as 
r. ,  /  =  1,  2,  3 ,  and  there  are  3  paths  in  the  reference-terminal-group,  denoted  as  fl. , 
/  =  1,  2,  3 .  For  the  remaining  9  paths,  neither  in  the  reference-initial-group  nor  in  the 
reference-terminal-group,  there  are  3  paths  in  each  of  the  initial-groups  (terminal-groups) 
other  than  the  reference-initial-group  (reference-terminal-group),  denoted  as  P, , 
i=\,  2,  ...,  9. 
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Stage  1:  These  16  paths  originate  from  a  same  state  and  reaeh  4  different  states.  They  are 
within  a  butterfly.  (See  Figure  5.2(a).)  A  box  represents  a  butterfly.  The  4  transitions  in 
an  initial-group  are  the  same  while  those  in  a  terminal-group  eonstitute  a  simplex- 
transitioni.  The  originating  state  of  these  16  paths  is  related  to  a  unique  symbol  in  IIS,  the 
related  souree  simplex  to  that  symbol  is  assigned  to  the  simplex-transitioni  at  this  stage. 
Denote  the  symbols  assigned  to  the  four  transitions  from  top-to-bottom  in  STM  at  this 
stage  as  ,  s^,  and  .  Then  {s.  \i  =  1,2, 3, 4}  is  a  souree  simplex. 
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Figure  5.2  The  16  paths  in  STM  and  corresponding  symbol  matrix  at  stage  1  for 

HDCTCM(4,  D)  with  L  =  D  +  2 


To  illustrate  the  distances  of  these  16  paths,  we  place  the  symbols  assigned  to 
these  paths  at  each  stage  into  a  4  x  4  matrix.  A  symbol  is  a  unit  element  in  this  matrix. 
Place  the  symbols  assigned  to  an  initial-group  into  a  row  and  place  the  symbols  assigned 
to  a  terminal-group  into  a  column  in  this  matrix.  The  symbols  assigned  to  the  four  initial- 
groups  (terminal-groups)  located  in  STM  from  top-to-bottom  or  from  left-to-right  are 
placed  into  the  first  to  fourth  row  (column).  This  matrix  is  called  the  symbol  matrix.  We 
see  that  there  is  one  to  one  correspondence  between  the  locations  of  these  16  paths  in 
STM  and  the  locations  of  the  symbols  assigned  to  these  paths  in  the  symbol  matrix. 
Later,  we  will  say  a  path  is  at  a  certain  location  in  the  symbol  matrix,  as  well.  That  means 
the  symbol  assigned  to  this  path  is  at  that  location  in  the  symbol  matrix.  The  distance 
from  a  symbol  to  the  reference-symbol  in  the  symbol  matrix  will  give  the  distance  from 
the  corresponding  path  to  the  reference-path. 

The  symbol  matrix  at  this  stage  is  shown  in  Figure  5.2(b).  The  distance  between 
Sj  and  y,  it  =  1,  2,  3,  4  is  0  when  j  =  k,  and  8  when  j^k.  Pair-wise  distances 
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between  symbols  are  all  known.  So,  we  do  not  need  to  know  the  aetual  values  in  the 
symbol  Sj.  The  loeation  of  the  referenee-symbol  in  the  symbol  matrix  will  fix  the 

distanee  from  eaeh  of  the  other  15  symbols  to  the  referenee-symbol.  (See  Figure  5.2(b).) 
Later,  the  distanee  between  a  symbol  and  the  referenee  symbol  will  be  referred  to  as  the 
distanee  of  a  symbol.  Denote  the  row  and  eolumn  eontaining  the  referenee  symbol  as  the 
referenee-row  and  referenee-eolumn.  In  Figure  5.2(b),  the  erossed  out  row  and  eolumn 
are  the  referenee-row  and  referenee-eolumn,  respeetively.  The  interseetion  is  the 
referenee-symbol.  The  distanee  of  a  symbol  is  written  in  the  braeket  besides  the  symbol. 
The  matrix  resulting  by  replaeing  a  symbol  in  a  symbol  matrix  with  its  distanee  is  ealled 
a  distanee  matrix.  No  matter  where  the  referenee-symbol  is  loeated  at— among  the  15 
symbols  other  than  the  referenee-symbol— the  distanee  is  0  for  all  the  three  symbols  in  the 
referenee-row.  For  all  three  symbols  in  the  referenee-eolumn,  the  distanee  is  8.  For  the 
other  9  symbols,  the  distanee  is  8. 

Therefore,  the  distanees  of  the  15  paths  other  than  the  referenee-path  have  the 
following  property:  the  distanees  of  the  3  paths  in  the  referenee-initial-group  are  all  0;  the 
distanees  of  the  3  paths  in  the  referenee-terminal-group  are  all  8;  and  the  distanees  of  all 
the  other  9  paths  are  all  8. 

Stage  2:  These  16  paths  relate  to  4  originating  states;  an  initial-group  eonstitutes  a 
simplex-transitioni.  They  are  in  a  butterfly.  A  terminal-group  eonstitutes  a  simplex- 
transition2;  they  are  loeated  in  the  same  internal  loeations  of  a  set  of  4  butterflies  along 
the  first  dimension  of  STM.  (See  Figure  5.3(a).)  The  set  of  4  paths  having  the  same  line 
style  is  a  terminal-group. 
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Figure  5.3  The  16  paths  in  STM  and  corresponding  symbol  matrix  at  stage  2  for 

HDCTCM  (4,  Z)) with  L  =  D  +  2 


As  shown  in  Chapter  3,  the  set  of  the  four  signals  s.,  i  =  1,  2,  3,  4,  related  to 
these  four  originating  states  g^.  A:  =  1,  2,  3,  4 ,  is  a  type  B  simplex  6.  The  symbol 
assignment  is  made  such  that  four  transitions  in  the  simplex-transitioni  originating  from 
state  are  assigned  member  signals  from  the  related  source  simplex  to  signal  s., 
denoted  as  vj. .  Also,  each  of  these  four  simplex-transition2’s  is  assigned  a  type  B  simplex 
/  =  1,2,3, 4  formed  by  the  four  source  simplexes  gj,  .  So  in  the  symbol  matrix  for  this 
stage,  each  row  will  be  a  source  simplex  and  each  column  a  type  B  simplex  The 
“prototype”  symbol  matrix  is  shown  in  Figure  5.3  (b).  Numbers  1  to  6  are  used  to 
indicate  different  space  dimensions.  By  “prototype”  we  mean,  an  actual  symbol  matrix 
can  be  any  row  or  (and)  column  exchanged.  That  variation  results  from  different  absolute 
locations  of  these  16  paths  located  in  different  STMs.  Correspondingly,  signals  in 
different  type  B  simplex  6  (identified  by  the  negative  sign  locations  in  its  member 
signals)  will  be  related  to  the  four  originating  states  g^.,  that  will  give  different  gj.  and 
For  a  given  type  B  simplex  6,  there  is  one  and  only  one  arrangement  for  gj.  to  form  four 
It  can  be  verified  that  for  all  different  type  B  simplexes^,  the  symbol  matrixes  are  the 
“prototype”  symbol  matrix  with  some  row  or  (and)  column  exchanged. 

In  order  to  obtain  the  distances  of  the  symbols  in  the  symbol  matrix,  we  need  to 
know  the  actual  symbol  matrix  and  the  reference-symbol’s  location.  For  the  “prototype” 
symbol  matrix,  no  matter  where  the  reference-symbol  is  located— among  the  other  15 
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symbols  other  than  the  referenee  symbol— all  three  symbols  in  the  referenee-row  or  the 
referenee-eolumn  have  distanee  8,  beeause  the  symbol  assigned  to  eaeh  of  these  paths  is  a 
member  signal  of  the  souree  simplex  or  the  type  B  simplex  eontaining  the  referenee- 
symbol.  Cross  out  the  referenee-row  and  referenee-eolumn;  for  the  symbols  in  the  left 
3  X  3  matrix,  their  distanees  are  either  4  or  8.  There  is  one  and  only  one  distanee  8  in  eaeh 
row  (eolumn),  and  the  eolumn  (row)  index  of  distanee  8  in  eaeh  row  (eolumn)  is 
different.  (See  Figure  5.3(b).)  Denote  eaeh  of  these  three  loeations  where  the  symbol 
loeated  at  these  loeations  have  distanee  8  as  a  speeial-8-loeation.  For  a  given  row  and 
eolumn  indexes  of  the  referenee-symbol  in  a  symbol  matrix,  exehange  some  rows  or 
(and)  eolumns  in  this  “prototype”  symbol  matrix;  the  resultant  distanee  matrix  will  be  the 
distanee  matrix  obtained  from  the  “prototype”  symbol  matrix  with  those  rows  or  (and) 
eolumns  exehanged.  We  ean  see  the  distanee  property  deseribed  above  will  not  ehange 
for  these  resultant  distanee  matrixes.  That  is  to  say,  any  aetual  symbol  matrix  has  the 
distanee  property  deseribed  above. 

Therefore,  at  this  stage,  the  following  property  of  the  15  paths  other  than  the 
referenee-path  holds;  the  distanees  of  the  3  paths  in  the  referenee-initial-group  and  the  3 
paths  in  the  referenee-terminal-group  are  all  8.  Among  the  other  9  paths  P,, 
/  =1,  2,  ...  ,  9,  eaeh  initial-group  (terminal-group)  eontains  one  path  having  distanee  8 
and  two  paths  having  distanee  4.  Eaeh  of  the  three  paths  having  distanee  8— denoted  as  a 
speeial-8-path— belongs  to  a  different  terminal-group  (initial-group).  We  name  the 
distanee  property  at  this  stage  as  Distanee  Rule  1 . 

Stage  3  toD:  At  stage  i ,  where  3<  i<  D,  these  1 6  paths  originate  from  1 6  different 
originating  states  and  reaeh  16  different  next  states.  An  initial-group  eonstitutes  a 
simplex-transitioni-i;  they  are  loeated  in  the  same  internal  loeations  of  the  set  of  4 
butterflies  along  the  (/- 2) dimension  in  STM  and  have  the  same  loeation  indexes  along 
all  the  other  dimensions.  Four  initial-groups  are  in  4  sets  of  4  butterflies  along  the 
(/- 2)^^  dimension.  A  terminal-group  eonstitutes  a  simplex-transitioui.  They  are  loeated 
in  the  same  internal  loeations  of  the  set  of  4  butterflies  along  the  (/-I),/,  dimension  in 
STM  and  have  the  same  loeation  indexes  along  all  the  other  dimensions.  Four  terminal- 
groups  are  in  4  sets  of  4  butterflies  along  (i  - 1)^^  dimension.  Eaeh  of  the  4  paths  from  an 
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initial-group  belongs  to  a  different  terminal-group  and  vice  visa.  So,  these  16  paths  are  in 
16  different  butterflies.  These  butterflies  are  located  in  a  two-dimensional  plane  along  the 
(/  -  and  (/  -  2),^  dimension  of  STM.  (See  Figure  5.4(a).) 
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Figure  5.4  The  16  paths  in  STM  and  corresponding  symbol  matrix  at  stage  i,  where 
3  <  /  <  Z),  for  HDCTCM(4,Z))with  L  =  D  +  2 


A  simplex -transitioui,  where  2<i<D,  is  assigned  a  type  B  simplex.  State 
transitions  originating  from  different  states  will  be  assigned  symbols  occupying  at  least 
two  different  dimensions  for  two  pulse-locations.  So  the  symbol  matrix  at  this  stage 
should  have  the  following  property:  the  set  of  symbols  in  each  row  and  each  column  is  a 
type  B  simplex.  And  all  the  symbols  occupy  at  least  two  different  dimensions  for  two 
pulse-locations.  Call  this  property  “the  property  of  symbol  matrix”. 

Denote  the  symbol  in  row  j  and  column  k,  j,  k  =  \,  2,  3,  4  as  (See  Figure 

5.4(b).)  Then  for  each  j,  |  A:  =  1,  2,  3,  4}  is  a  type  B  simplex  and  for  each  k, 
{^jk  I  7  -  1’  2,  3,  4}  is  a  type  B  simplex.  The  “copy”  rule  should  be  satisfied  in  any  type  B 
simplex.  We  will  see  that  we  do  not  need  to  know  the  actual  values  in  symbol 
knowing  the  location  of  the  reference-symbol  in  this  symbol  matrix  will  give  all  the 
symbols’  distances. 
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Denote  the  row  index  or  the  column  index  of  the  symbol  matrix  as  r,  or  c, ,  where 
/  =  h  2,  3,  4  and  r,,  c,  e{l,  2,  3,  4}  .  Suppose  the  reference-symbol  is  in  (rj,Cj).  The 
distances  of  the  other  three  symbols  in  row  and  column  Cj  will  all  be  8,  because  each 
of  these  symbols  is  a  member  signal  of  a  type  B  simplex  containing  the  reference- 
symbol.  These  symbols  are  related  to  the  reference-symbol  by  “copy”  rule  for  pulse- 
locatioum,  m  =  h  2,  3  along  the  reference-row  or  the  reference-column. 

Cross  out  the  reference-row  and  the  reference-column.  In  the  left  3x3  matrix, 
for  each  pulse-locationm  in  the  reference-symbol,  apply  “copy”  rule  twice— once  along  the 
row  and  once  along  the  column.  A  symbol  can  be  identified  to  have  distance  4.  That  is 
because  twice  “copy”  will  make  pulse-locatioum  in  this  identified  symbol  have  the  same 
absolute  value  and  the  same  sign  as  pulse-locationm  in  the  reference-symbol.  Each  of  the 
other  two  pulse-locationp,  p^m,  occupies  different  dimensions  in  this  identified  symbol 
and  the  reference  symbol.  So  the  distance  of  the  identified  symbol  is  4. 

Let  us  see  how  to  identify  those  three  symbols.  Recall  that  the  “copy”  rule  is 
defined  in  matrix  pair  in  Equation  (3.2).  Eor  a  given  signal  location,  its  pair  locations  for 
pulse-locationm,  m  =  1,  2,  3  and  pulse-locationp,  where  p^m,  are  different.  Eirst,  in 
column  Cj,  for  each  pulse-locationm  in  the  reference-symbol,  find  the  pair  location  of  the 
row  index  ,  denoted  as  ;  then  ^  q  and  r2^  r^.  Secondly,  in  each  row  , 

find  the  pair  location  of  the  column  index  Cj  for  pulse-locationm,  denoted  as  ;  then 
Cm+i  ^  q,  and  Cj  ^  c^.  The  distance  of  the  symbol  in  is  4.  That  is  to  say,  in 

each  of  the  three  rows,  there  is  one  symbol  having  distance  4  and  the  column 
indexes  of  these  three  symbols,  are  different.  Denote  each  as  a  special-4- 

location.  Eor  the  remaining  6  symbols  in  the  3x3  matrix,  they  are  not  related  to  the 
reference-symbol  by  “copy”  rule  either  once  (in  the  reference-row  or  reference-column) 
or  twice;  they  occupy  three  different  dimensions  from  the  reference-symbol.  Their 
distances  will  all  be  6.  (See  Eigure  5.4  (b).) 

In  summary,  at  this  stage  the  distances  of  the  15  paths  other  than  the  reference- 
path  have  the  following  property:  the  3  paths  in  the  reference-initial-group  and  the  3 
paths  in  the  reference-terminal-group  all  have  distance  8.  Eor  the  other  9  paths  P,  , 
/  =1,  2,  ...  ,  9,  each  initial-group  (terminal-group)  contains  one  path  having  distance  4 
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and  two  paths  having  distance  6.  Each  of  the  three  paths  having  distance  4— denoted  as  a 
special-4-path— belongs  to  a  different  terminal-group  (initial-group).  We  name  the 
distance  property  at  this  stage  as  Distance  Rule  2. 

Stage  Z)  + 1 :  These  16  paths  originate  from  16  different  states  and  reach  4  different  next 
states.  An  initial-group  constitutes  a  simplex-transitiono.  They  are  located  in  the  same 
internal  locations  of  the  set  of  4  butterflies  along  the  (D-l),^  dimension  of  STM.  A 
terminal-group  constitutes  a  simplex-transitiouD.  They  are  in  a  butterfly.  (See  Figure  5.5 
(a).) 
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Figure  5.5  The  16  paths  in  STM  and  corresponding  symbol  matrix  at  stage  D  +  \  for 

HDCTCM(4,D)with  L  =  D  +  2 


A  simplex-transitiouD  or  a  simplex-transitionD+i  is  assigned  a  type  B  simplex.  So 
in  the  symbol  matrix  at  this  stage,  the  set  of  the  4  symbols  in  each  row  or  in  each  column 
is  a  type  B  simplex,  and  all  the  symbols  occupy  at  least  two  different  dimensions  for  two 
pulse-locations.  Therefore,  the  symbol  matrix  at  this  stage  satisfies  “the  property  of 
symbol  matrix”.  The  symbol  matrix  can  be  denoted  as  the  same  as  the  symbol  matrix  at 
stage  3  to  D.  (See  Figure  5.5  (b).)  Then  the  distance  property  of  the  15  paths  other  than 
the  reference-path  will  be  the  same  as  the  distance  property  derived  for  stage  3  to  D. 
That  is  to  say.  Distance  Rule  2  is  also  satisfied  at  this  stage. 

Stage  D  +  2:  These  16  paths  originate  from  4  different  states  and  reach  a  same  next  state. 
They  are  in  a  butterfly.  An  initial-group  constitutes  a  simplex-transitiouD+i  and  the  4 
transitions  in  a  terminal-group  are  the  same.  (See  Figure  5.6  (a).) 
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Figure  5.6  The  16  paths  in  STM  and  corresponding  symbol  matrix  at  stage  D  +  2  for 

HDCTCM(4,D)with  L  =  D  +  2 


A  simplex-transitionD+i  is  assigned  a  type  B  simplex.  Denote  the  symbols 
assigned  to  the  4  transitions  in  the  simplex-transitionD+i  at  this  stage  from  top-to-bottom 
as  s^,  $2,  ^3,  and  X4.  Then  {s.  |/  =  1,  2,  3,  4}  is  a  type  B  simplex  and  the  distance 
between  Sj  and  y,  A:  =  1,  2,  3,  4  is  0  when  j=k,  and  8  when  j^k.  The  symbol 
matrix  is  shown  in  Figure  5.6  (b).  No  matter  where  the  reference-symbol  is  located, 
among  the  15  symbols  other  than  the  reference-symbol,  the  three  symbols  in  the 
reference-row  all  have  distance  8  and  the  three  symbols  in  the  reference-column  all  have 
distance  0.  The  distance  for  the  other  9  symbols  is  8. 

Therefore,  the  distances  of  the  15  paths  other  than  the  reference-path  have  the 
following  property;  the  distances  of  the  3  paths  in  the  reference-initial-group  are  all  8,  the 
distance  of  the  3  paths  in  the  reference-terminal-group  are  all  0,  and  the  distances  of  all 
the  other  9  paths  are  all  8. 

5.1,4  Upper  and  Lower  Bounds  on  the  Minimum  Distance 

From  the  analysis  of  the  distances  of  the  15  paths  other  than  the  reference-path, 
we  can  see: 

1.  Each  of  the  3  paths  in  the  reference-initial-group  and  the  3  paths  in  the  reference- 
terminal-group  has  distance  8  at  D  -1- 1  stages  and  distance  0  at  one  stage.  So  the 
distance  of  each  of  these  paths  is  8  •  (D  -l- 1) . 
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2.  For  each  of  the  other  9  paths  P,. ,  /  =  1,  2,  ,  9 ,  at  stage  1  and  stage  D  +  2  the  distance 

is  8.  At  stage  2,  the  distance  is  either  8  or  4.  At  stage  i,  3<  i<  D,  the  distance  is  either 
4  or  6.  The  distance  of  path  P,  can  be  written  as  S  +  S  +  H-  =\6  +  where 


D+l 


dy  ,  dy  is  the  distance  of  path  P.  at  stage  j .  Since  the  smallest  value  dy  can 

7=2 

take  is  4,  the  minimum  H.  among  all  i  is  lower  bounded  by  4Z)  and  denoted  as 

The  lower  bound  on  the  minimum  distance  of  these  15  paths  is 

r  8 •  (Z)  +  1)  ,  D<3 


(5.1) 

It  also  can  be  seen  from  the  Distance  Rule  1  and  Rule  2, 
9 

Z  //.  =  3*[(8  +  4  +  4)  +  (6  +  6  +  4)*(D  +  l-3  +  l)]  =  48-D  (5.2) 

i=\  ' 


So,  the  minimum  H.  among  all  i  is  also  upper  bounded  by  a  particular  value.  This 
happens  when  all  the  Hds  take  values  as  large  as  possible,  but  all  larger  than  that 


particular  value.  If  there  is  no  other  restriction,  this  happens  when  all  the  H-'s  are 
equal.  But  since  the  distance  can  only  be  an  even  integer,  that  particular  value  is 

.  Denote  it  as  . 


48Z) 

16D 

9  J 

even 

3 

-‘even 

Then  the  upper  bound  of  the  minimum  distance  of  these  entire  15  paths  is 

,  D<3 


min {8 -(D  +  l),  \6  +  H^J  = 


8-(D  +  l) 
,  16Z) 

16  + 


D>3 


(5.3) 


Aeven 


The  state  transition  pattern  of  the  16  paths  shown  above  does  not  depend  on  the 
starting  state,  so  the  distance  property  will  be  the  same  for  the  16  paths  associated  with 
any  possible  starting  state.  Also,  the  distance  property  derived  above  does  not  depend  on 
which  path  among  these  16  paths  one  chooses  as  the  reference-path.  Therefore,  the  upper 
and  lower  bounds  derived  are  the  bounds  on  the  minimum  distance  among  the  16  paths 
associated  with  any  starting  state  for  HDCTCM(4,D)  at  L  =  D-i- 2.  That  is  to  say,  the 
bounds  are  the  bounds  on  the  minimum  distance  of  HDCTCM(4,D)  codes  with 
T  >2D  +  (0~2). 
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5,1.5  Coding  Gain 

From  the  bounds  of  the  minimum  distanee  of  HDCTM(4,Z)),  we  ean  evaluate  the 
eoding  gain  of  HDCTM(4,Z))codes.  Take  uncoded  4-PSK  as  a  reference  system.  Coding 
gain  is  defined  in  Equation  (2.5).  For  HDCTM(4,£)),  if  using  3-out-of-N  signaling 
scheme  with  unit  pulse  in  each  occupied  dimension,  S^^=3.  For  uncoded  4-PSK, 
^min  =2  when  =1 .  When  HDCTM(4,Z))  codes  have  the  upper  and  lower  bounds  on 
the  minimum  distance,  the  maximum  and  minimum  coding  gain  can  be  calculated.  Table 
5.1  shows  the  results  for  Z)  =  1,  2,  3,  4,  5  .  These  coding  gains  will  be  achieved  at  high 
signal-to-noise  ratio. 


Table  5.1  Minimum  and  Maximum  Coding  Gains  of  HCTCM(4,  D)  Codes 


Trellis  depth  D 

Minimum  coding  gain 

Maximum  coding  gain 

1 

4.26 

4.26 

2 

6.02 

6.02 

3 

6.69 

7.27 

4 

7.27 

7.78 

5 

7.78 

8.45 

5,2  Tightness  of  the  Bounds  on  the  Minimum  Distance 

This  section  proves  that  the  upper  and  lower  bounds  on  the  minimum  distance 
derived  in  Section  5.1.4  can  be  reached.  First,  we  show  that  to  prove  that  the  bounds  can 
be  reached  is  to  find  a  valid  distance  that  can  lead  to  the  bounds.  Then  we  prove  a 
theorem  on  the  conditions  for  a  distance  distribution  to  be  valid.  Following  that,  valid 
distance  distributions  that  can  reach  the  bounds  are  built. 
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5,2.1  Conditions  for  the  Bounds  to  be  Reached 

For  a  given  D ,  for  HDCTCM  (4,  D)  codes  at  Z  =  Z)  +  2 ,  there  are  1 6  paths  related 
to  a  certain  starting  state.  The  derivation  of  the  distance  property  among  these  16  paths  at 
each  stage  does  not  depend  on  a  particular  STM.  Regardless  of  different  STMs  (different 
codes),  among  those  15  paths  other  than  the  reference-path,  the  3  paths  in  the  reference- 
initial-group  always  have  a  same  fixed  distance  at  each  stage  from  stage  1  to  Z)  +  2 ,  as  do 
the  3  paths  in  the  reference-terminal-group.  The  other  9  paths  P,  ,  i  =1,  2,  ...  ,  9,  always 
have  a  same  fixed  distance  at  stage  1  and  D  +  2  and  comply  with  Distance  Rule  1  at 
stage  2  and  Distance  Rule  2  at  each  stage  from  stage  3  to  D  +  \.  Distance  Rule  1  and 
Rule  2  do  not  give  a  fixed  value  for  all  these  9  paths  at  each  stage  from  stage  2  to  D  +  \. 
A  particular  path  P,  can  have  distance  either  8  or  4  at  stage  2  and  can  have  distance  either 
4  or  6  at  each  stage  from  stage  3  to  D  + 1 .  This  depends  on  the  location  of  the  symbol 
assigned  to  P,  at  that  stage;  i.e.,  it  depends  on  the  path’s  location  in  STM.  For  different 
STMs,  the  absolute  locations  of  these  16  paths  in  STM  will  be  different.  So  the  distance 
of  a  particular  path  P.  at  stages  from  2  to  D  +  l  can  be  different  in  different  STMs.  Name 
the  distances  of  some  paths  as  the  distance  distribution  of  these  paths;  this  means 
different  STMs  can  give  different  distance  distribution  of  the  9  paths  P.,  /  =  1,  2,  ... ,  9 . 
From  the  derivation  of  bounds,  the  minimum  distance  of  the  9  paths,  P. ,  determines  the 
minimum  distance  among  these  16  paths.  If  there  is  a  STM  that  gives  a  distance 
distribution  of  the  9  paths  P, ,  /  =  1,  2,  ...  ,  9  from  stage  2  to  stage  D  +  l,  which  satisfies 
H,  >  ,  for  all  /  ,  /  =  1,  2,  ...  ,  9  (5.4) 

and  there  is  at  least  one  path  P.  satisfying 

(5.5) 

Then  the  minimum  distance  of  the  9  paths  P,  is  ,  and  the 

minimum  distance  among  these  16  paths  is  the  upper  (lower)  bound  derived  in  Section 
5.1.4. 

Define  a  valid  distance  distribution  as  a  distance  distribution  that  can  be  obtained 
by  at  least  one  STM  (one  code).  If  we  can  build  a  valid  distance  distribution  of  these  16 
paths  that  can  lead  to  the  bounds,  then  we  can  claim  that  the  bounds  can  be  reached. 
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In  a  valid  distance  distribution,  among  the  15  paths  other  than  the  referenee-path, 
the  distanee  of  eaeh  of  the  paths  in  the  reference-initial-group  or  in  the  referenee- 
terminal-group  must  have  the  fixed  value  shown  in  the  distanee  property  at  eaeh  stage 
from  stage  1  to  D  +  2  .  The  distanee  of  eaeh  of  the  9  paths  P, ,  must  have  the  fixed  value 
shown  in  the  distanee  property  at  stage  1  and  D  +  2 .  That  is  to  say,  to  build  a  valid 
distanee  distribution,  we  only  need  to  speeify  the  distanees  of  the  9  paths  P, ,  at  eaeh  stage 
from  stage  2  to  D  +  l.  This  is  the  distanee  distribution  we  will  talk  about  later.  We  ean 
see  a  valid  distanee  distribution  must  eomply  with  Distanee  Rule  1  at  stage  2  and 
Distanee  Rule  2  at  eaeh  stage  from  stage  3  to  D  +  \.  Later,  when  we  say  a  distanee 
distribution  eomplies  with  Distanee  Rule  1  and  Rule  2,  we  mean  it  eomplies  with 
Distanee  Rule  1  at  stage  2  and  Distanee  Rule  2  at  eaeh  stage  from  stage  3  to  D  +  l. 
Before  we  investigate  the  other  eonditions  that  eonstrain  a  distanee  distribution  to  be  a 
valid  distanee  distribution,  we  diseuss  how  to  find  a  STM  (a  eode)  in  order  to  obtain  a 
distanee  distribution  built  under  Distanee  Rule  1  and  Rule  2  and  prove  two  lemmas. 

5,2,2  Find  an  STM  to  Obtain  a  Distance  Distribution  Built  under  Distance  Rule  1 
and  Rule  2 

A  distance  distribution  built  under  Distance  Rule  1  at  stage  2  specifies  that  among 
the  9  paths,  P,  ,  /  =1,  2,  ...  ,  9  ,  each  of  the  initial-groups  (terminal-groups)  other  than  the 
reference-initial-group  (reference-terminal-group)  contains  one  special-8-path.  Each  of 
the  three  special-8-paths  belongs  to  a  different  terminal-group  (initial-group)  other  than 
the  reference-terminal-group.  All  the  other  6  paths  have  distance  4. 

A  distance  distribution  built  under  Distance  Rule  2  at  any  stage  from  stage  3  to 
D  +  l  specifies  that  among  the  9  paths,  P,  ,  i  =1,  2,  ...  ,  9,  each  of  the  initial-groups 
(terminal-groups)  other  than  the  reference-initial-group  (reference-terminal-group) 
contains  one  special-4-path.  Each  of  the  three  special-4-paths  belongs  to  a  different 
terminal-group  (initial-group)  other  than  the  reference-terminal-group.  All  the  other  6 
paths  have  distance  6. 

At  each  stage  from  stage  2  to  D  + 1 ,  these  16  paths  can  be  depicted  in  STM,  as  in 
Eigures  5.3  to  5.5,  along  with  the  corresponding  symbol  matrix.  Note  the  symbols  in  the 
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symbol  matrix  and  the  path  in  STM  at  this  stage  have  one  to  one  correspondenee.  After 
we  obtained  the  actual  symbols  matrix  (necessary  only  at  stage  2)  and  know  the  location 
of  the  reference-symbol  in  the  symbol  matrix,  the  distances  of  other  symbols  in  the 
symbol  matrix  can  be  obtained.  They  comply  with  Distance  Rule  1  at  stage  2  and 
Distance  Rule  2  at  each  stage  from  stage  3  to  D  + 1 .  This  is  satisfied  by  all  different 
codes  (different  STMs).  To  get  the  wanted  distance  distribution  satisfying  Distance  Rule 
1  and  Rule  2,  we  can  place  these  16  paths  into  the  symbol  matrix  such  that  the  path 
having  distance  d  is  placed  into  a  location  where  the  symbol  at  that  location  has  distance 
d  .  We  claim  the  following  statement: 

Statement  5.1  If  we  place  an  initial-group  in  a  row  and  a  terminal-group  in  a  column  in 
the  symbol  matrix,  then,  to  obtain  the  wanted  distance  distribution  satisfying  Distance 
Rule  1  and  Rule  2,  we  only  need  to  guarantee  that  among  the  9  paths,  P; ,  z  =  1,  2,  ...  ,  9 , 
the  special-8-paths  are  placed  in  those  special-8-locations  at  stage  2  and  the  special-4- 
paths  are  placed  in  those  special-4-locations  at  each  stage  from  stage  3  to  D  + 1 . 

Proof:  For  each  stage  from  stage  2  toD-l- 1  in  the  symbol  matrix,  the  symbols  in 
the  reference-row  and  the  reference-column  all  have  distance  8.  If  we  place  an  initial- 
group  in  a  row  and  a  terminal-group  in  a  column  in  the  symbol  matrix,  these  will  be  the 
locations  where  the  paths  in  the  reference-initial-group  and  the  reference-terminal-group 
should  be  placed.  In  the  symbol  matrix,  cross  out  the  reference-row  and  the  reference- 
column;  in  the  left  3x3  matrix,  the  symbols  in  the  locations  other  than  the  three  special- 
8-locations  or  special-4-locations  all  have  distance  4  at  stage  2  and  distance  6  at  each 
stage  from  stage  3  to  stage  D  +  l.  These  will  be  the  locations  of  the  other  6  paths  other 
than  the  special-8-paths  or  the  special-4-paths  among  the  9  paths  P.,  z  =  1,  2,  ...  ,  9 , 
should  be  placed  into.  In  the  wanted  distance  distribution,  the  distances  of  the  paths  other 
than  the  special-8-paths  or  the  special-4-paths  have  these  values,  respectively,  because 
that  is  what  the  distance  distribution  built  under  Distance  Rule  1  and  Rule  2  means.  We 
only  need  to  guarantee  that  among  the  9  paths,  fy ,  z  =  1,  2,  ...  ,  9 ,  the  special-8-paths  are 
placed  in  those  special-8-locations  at  stage  2  and  the  special-4-paths  are  placed  in  those 
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special-4-locations  at  each  stage  from  stage  3  to  Z)  + 1 .  All  the  other  paths  will  have  the 
wanted  distances  in  the  distance  distribution  built  under  Distance  Rule  1  and  Rule  2. 

Placing  these  16  paths  in  the  symbol  matrix  at  each  stage  is  equivalent  to  placing 
these  16  paths  in  a  corresponding  order  in  STM  at  this  stage;  i.e.,  define  some  properties 
of  STM,  which  are  indicated  by  some  elements  in  STM-FREE.  If  by  placing  these  16 
paths  in  the  symbol  matrix  to  get  one  distance  distribution  built  under  Distance  Rule  1 
and  Rule  2  can  define  all  the  elements  in  STM-EREE,  then  it  shows  that  there  is  at  least 
one  STM  that  can  give  this  distance  distribution.  In  other  words,  this  distance  distribution 
is  valid. 

5,2,3  Proofs  of  Two  Lemmas 

Lemma  5,1  In  HDCTCM(n,D),  given  a  specific  butterfly's  location  in  STM— say 
STM(/j,4,...,/^_j)— then  all  sets  of  n  butterflies  that  will  be  in  set  of  n  locations  having 
Xj  =  4,  A:  =  1,  2,  D-\  will  be  known. 

Proof:  We  have  already  shown  that  for  HDCTCM(n,D),  all  sets  of  n  butterflies 
constitute  simplex-transitioui  where  2<i  <  D  are  known.  Then  given  a  butterfly  in 
STM(/j,4,...,/^_i) ,  the  simplex-transition2-butterfly-set  containing  it  will  occupy 
STM(:,4,...,4i-i)  •  Then  the  simplex -transitions-butterfly-sets  containing  the  butterflies 
in  STM(:,4,...,4.-i)  will  occupy  STM(:,:,4,/4,...,4)-i);  the  simplex-transition4-butterfly- 
sets  containing  the  butterflies  in  STM(:,:,4,/4,...,/£,_i)  will  occupy  1^,1^,..., I The 
simplex-transitionm-butterfiy-sets  containing  the  butterflies  in  STM(:,:,...,:,/^_j,4,...,4,_i) 
will  occupy  STM(:,:,...,:,4,4^j,...,/^_j);  Until  the  end,  the  sets  of  butterflies  occupy 

:,/j3_j)  will  be  recognized. 

We  have  recognized  the  sets  of  butterflies  should  be  located  in 
STM(:,:, ...,:, 4, 4+1, •••Ji.-i)  for  any  k  ,  where  1<A:<D-1.  The  simplex-transitionk+2- 
butterfly-sets  containing  the  butterflies  in  STM(:,:, ...,:, 4, 4+iv,/z)_i)  will  occupy 
STM(:,:, ...,:, 4, :,4+2’4+3v,/£.-i)-  The  simplex-transitionk+3-butterfly-sets  containing  the 
butterflies  in  STM(:,:, ...,:,4, 1,4+2, 4+3, ...,/j3_i)  will  occupy  :,4,:,:, 4+3, 4+4, ...,/2,_i). 

Eventually,  the  simplex-transitionD-butterfiy-sets  containing  the  butterflies  in 
STM(:,:,...,:,4,:,...,:,/£,_i),  which  are  recognized  in  the  pervious  stage,  will  occupy 
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STM(:,;, 4, i.e.,  all  the  sets  of  butterflies  that  oeeupy  a  set  of  n  loeations 
having  =  4^  k  =  l,  2,  1  are  reeognized. 

Lemma  5.2  In  a  symbol  matrix  having  “the  property  of  symbol  matrix”,  suppose  we 
know  the  row  index  that  one  initial-group  should  be  plaeed  in  and  the  eolumn  indexes  of 
the  four  paths  in  this  initial-group,  i.e.,  the  eolumn  indexes  of  the  four  terminal-groups. 
Call  this  initial-group  the  reeognized  initial-group  in  the  proof.  Then  for  any  wanted 
distanee  distribution  built  under  Distanee  Rule  2,  there  is  one  and  only  one  way  to  plaee 
the  other  three  initial-groups  in  the  other  three  rows  in  the  symbol  matrix  to  get  to  obtain 
this  distanee  distribution. 

Proof:  In  the  symbol  matrix,  denote  the  row  index  that  this  reeognized  initial-group 
should  be  plaeed  in  as  .  The  eolumn  indexes  of  the  four  terminal-groups  are  known. 
Denote  the  column  index  of  the  reference-terminal-group  as  Cj.  Then,  there  are  two 
situations: 

Case  1:  This  recognized  initial-group  is  the  reference-initial-group,  i.e.,  the  reference- 
symbol  is  in  (rj,Ci).  In  Section  5.1.3,  in  the  derivation  of  Distance  Rule  2,  we  have  shown 
that  in  the  symbol  matrix  having  “  the  property  of  symbol  matrix”,  knowing  the  location 
of  the  reference-symbol  in  the  symbol  matrix,  the  three  special-4-locations  will  be 
determined  by  applying  the  “copy”  rule  along  the  row  and  column.  Denoted  these  three 
special-4-locations  as  (r^,c.),  i  =2,  3,  4.  We  have  shown  there  that  r.  r^, 

c.  ^  Cj,  and  Cj  ^  c^.  For  each  column  c. ,  /  =  2,  3,  4 ,  we  know  which  terminal-group 

should  be  placed  in  this  column.  Then  in  the  wanted  distance  distribution  built  under 
Distance  Rule  2,  the  initial-group  having  a  special-4-path  that  belongs  to  this  terminal- 
group  should  be  placed  in  row  r. . 

Case  2:  This  recognized  initial-group  is  not  the  reference-initial-group.  Then  in  the 
wanted  distance  distribution,  this  initial-group  must  contain  a  special-4-path,  which 
belongs  to  a  known  terminal-group  other  than  the  reference-terminal-group.  The  column 
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indexes  of  all  the  terminal-groups  are  known,  so  we  know  the  eolumn  index  that  this 
speeial-4-path  should  be  plaee  in,  and  denote  it  as  ;  eertainly  c^.  So,  this  speoial-4- 
path  is  plaeed  in  (r^Cj)  in  the  symbol  matrix.  We  know  that  the  speeial-4-loeations  are 
the  loeations  in  the  symbol  matrix  that  relate  to  the  referenee-symbol  by  applying  "eopy" 
rule  twiee— onee  along  the  row  and  onee  eolumn.  Therefore,  knowing  {r^,C2)  is  sueh  a 
speoial-4-path,  we  ean  find  the  loeation  of  the  referenee-symbol  baekwards.  Then  the 
other  two  speoial-4-looations  ean  be  determined  afterwards. 

We  know  the  referenee-terminal-group  should  be  plaeed  in  eolumn  Cp  so  the 
referenee-symbol  must  also  be  plaeed  in  eolumn  Cj .  We  need  to  find  out  the  row  index  of 
the  referenee-symbol  first.  From  Equation  (3.2),  we  ean  find  out  the  pulse-loeation  that 
has  a  loeation  pair  (CpCj).  Suppose  it  is  pulse-loeationi,  /  e  {1,  2,  3} .  Then  for  pulse- 
loeationi,  in  column  Cj  find  the  pair  location  of  row  q  and  denote  it  as  Tj,  i.e.,  the 

reference-symbol  should  be  placed  in  row  r^.  Its  location  is  (^2,0)).  The  reference-initial- 
group  should  be  place  in  row  Tj  . 

Then  the  other  two  special-4-locations  are  determined  as  follows.  In  the 
reference-symbol,  for  each  of  the  other  two  pulse-locationm,  I  ^  m,  first  in  column  Cj  find 
the  pair  location  of  the  row  index  of  the  reference-symbol,  Tj  ,  and  denote  it  as  r-,  where 
i  =3,  4  and  r^.  Then,  in  each  row  r. ,  find  the  pair  location  of  the  column  index 

of  the  reference-symbol,  Cj,  dented  as  c.,  where  i  =3,  4  and  Cj  Then  the  other 

two  special-4-locations  are  i  =3,  4.  In  the  wanted  distance  distribution,  there  are 

two  other  initial-groups  other  than  the  recognized  group  and  the  reference-initial-group. 
They  each  have  a  special-4-path  which  belongs  to  the  terminal-groups  other  than  the 
reference-terminal-group  and  the  terminal-group  in  column  C2 .  For  each  of  the  column 
c. ,  i  =  3,  4 ,  we  know  which  terminal-group  should  be  place  in  this  column,  and  then  the 
initial-group  having  a  special-4-path  which  belongs  to  this  terminal-group  will  be  placed 
in  row  r. . 

In  either  case,  to  obtain  a  wanted  distance  distribution  built  under  Distance  Rule 
2,  the  other  three  initial-groups  will  be  uniquely  placed  into  the  other  three  rows  of  the 
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symbol  matrix,  and  the  column  indexes  of  the  four  terminal-groups  will  fix  the  order  of 
placing  the  four  paths  of  each  initial-group  in  its  row. 

5.2,4  Other  Conditions  for  a  Distance  Distribution  to  be  Valid 

The  only  other  possible  constraint  for  a  distance  distribution  to  be  valid  will  be 
the  relationship  of  the  distance  distributions  between  consecutive  stages  from  stage  2  to 
stage  Z)  + 1 .  This  will  be  answered  by  Theorem  5.1. 

Theorem  5.1  When  building  a  distance  distribution  from  stage  2  to  stage  D  +  \  under 
Distance  Rule  1  and  Rule  2,  there  is  no  relationship  of  the  distance  distributions  between 
consecutive  stages.  Any  distance  distribution  built  under  Distance  Rule  1  and  Rule  2  is  a 
valid  distance  distribution. 

This  theorem  says,  to  build  a  valid  distance  distribution,  among  the  9  paths,  P. , 
/  =  1,  2,  ...  ,  9 ,  one  can  let  any  three  paths  to  be  the  three  special-8-paths  at  stage  2  or  the 
three  special-4-paths  at  any  stage  from  stage  3  to  D  + 1  as  long  as  the  whole  distance 
distribution  at  that  stage  satisfies  Distance  Rule  1  at  stage  2  or  Distance  Rule  2  at  any 
stage  from  stage  3  to  D  + 1 .  There  is  no  relationship  between  consecutive  stages  on 
which  three  paths  one  chooses  to  be  the  special-8-paths  or  special-4-paths.  Any  distance 
distribution  built  under  Distance  Rule  1  and  Rule  2  is  a  valid  distance;  i.e.,  there  is  at 
least  one  STM  that  can  lead  to  this  distance  distribution. 

The  reason  is  that  a  STM  is  fully  determined  by  its  STM-FREE.  Erom  Eigures  5.3 
to  5.5,  the  locations  of  these  16  paths  in  STM  at  each  stage  from  stage  3  to  D  +  \  are  only 
related  to  two  elements  in  STM-EREE.  Applying  the  method  described  in  Section  5.2.2, 
we  will  see  that  obtaining  the  wanted  distance  distribution  under  Distance  Rule  2  in  the 
previous  stage  only  fixes  one  of  the  two  elements  of  STM-EREE;  the  other  is  to  be 
defined  by  this  stage's  distance  distribution.  Among  the  freedom  one  can  choose  for  this 
element  in  STM-EREE,  one  can  get  any  distance  distribution  built  under  Distance  Rule  2 
for  this  stage.  Stage  2  is  the  first  stage  to  build  a  distance  distribution.  (See  Eigure  5.2.) 
The  locations  of  these  16  paths  in  STM  are  related  to  the  rest  of  elements  in  STM-EREE. 


105 


Among  the  freedom  one  ean  ehoose  for  those  elements,  one  ean  also  obtain  any  distanee 
distribution  built  under  Distanee  Rule  1 .  We  will  prove  this  stage-by-stage. 


Proof: 

Stage  2:  At  this  stage,  eonsider  any  wanted  distanee  distribution  built  under  Distanee 
Rule  1. 

These  16  paths  in  STM  and  eorresponding  "prototype"  symbol  matrix  are  shown  in 
Figure  5.2.  The  speeial-8-loeations  depend  on  the  aetual  symbol  matrix.  So  we  must  first 
plaee  the  four  butterflies  eontaining  these  16  paths  into  some  partieular  loeations  in  STM 
to  obtain  the  aetual  symbol  matrix.  We  have  not  defined  any  part  of  STM  yet;  there  are 
many  ways  to  place  these  four  butterflies  in  STM  and  place  these  16  paths  into  particular 
locations  in  these  four  butterflies  to  obtain  the  wanted  distance  distribution.  But  when  a 
particular  way  is  selected,  some  elements  in  STM-FREE  will  be  defined. 

First,  choose  the  butterfly  whose  originating  state  set  contains  the  originating  state 
of  the  reference-initial-group,  g ,  as  the  anchor  butterfly.  This  defines  STM-FREE  (first 
butterfly).  Place  the  anchor  butterfly  in  an  arbitrary  location  in  STM — say, 
STM(/j,4,...,/^,i) .  This  defines  STM-FREE  (first  location).  Then  place  the  originating 
state  g  in  any  internal  location,  denoted  as  A: ,  in  the  left  side  of  the  anchor  butterfly. 
k  e  {1,  2,  3,  4} .  This  defines  part  of  STM-FREE  (left  side  butterfly).  Then  the  other  three 
butterflies  containing  the  other  three  initial-groups  will  be  placed  in  STM(xj,/2,...,/£,_i) , 
where  Xj  =://j.  The  order  of  placing  these  three  butterflies  has  not  been  determined  yet. 
And  the  other  three  originating  states  of  the  other  three  initial-groups  should  be  placed  in 
the  same  internal  locations  in  their  butterflies  as  the  originating  state  g  in  its  butterfly — 
the  anchor  butterfly. 

So  far,  we  have  known  the  four  butterflies'  locations  in  STM  and  the  16  state 
transitions'  internal  locations  in  these  butterflies.  From  Chapter  3,  the  symbols  assigned 
to  these  16  paths  at  this  stage  will  be  identified  from  the  signal  constellation.  The  symbol 
matrix  is  uniquely  determined.  From  the  mapping  between  STM  and  the  symbol  matrix, 
the  reference-initial-group  should  be  placed  in  row  q  =  in  the  symbol  matrix.  But  the 
order  of  placing  them  in  this  row  has  not  been  decided  yet.  We  can  place  the  four  paths  in 
the  reference-initial-group  in  row  in  an  arbitrary  order.  Map  back  to  STM,  the  next 
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states  of  these  four  paths  loeated  in  eolumn  1  to  column  4  in  the  symbol  matrix  will  be 
placed  in  the  right  side  of  the  anchor  butterfly  from  top-to-bottom.  This  defines  STM- 
FREE  (right  side  butterfly).  Since  each  path  in  an  initial-group  belongs  to  a  different 
terminal-group,  the  order  of  placing  the  four  paths  in  the  reference-initial-group  in  row 
of  the  symbol  matrix  will  tell  which  terminal-group  should  be  place  in  which  column. 
Thus,  we  know  the  column  indexes  of  the  four  terminal-groups.  Denote  the  column  index 
of  the  reference-terminal-group  as  Cj.  Then,  we  know  the  reference-symbol  is  in 
The  distance  of  all  the  other  symbols  can  be  determined.  They  comply  with  Distance 
Rule  1.  Denote  the  special-8-locations  as  where  i  =  2,  3,  4,  and 

Cj  ^  C3  ^  C4. 

In  the  wanted  distance  distribution,  the  three-special-8-paths  should  be  placed 
into  these  three  special-8-locations.  Eor  each  column  c,,  i  =2,  3,  4,  we  know  the 
terminal-group  that  should  be  placed  in  this  column.  Then  in  the  wanted  distance 
distribution,  the  initial-group  having  a  special-8-path  which  belongs  to  this  terminal- 
group  should  be  placed  in  row  and  the  order  of  placing  them  in  this  row  is  already 
fixed  by  the  known  column  indexes  of  the  four  terminal-groups.  Mapping  this  initial- 
group  in  the  symbol  matrix  back  to  STM  means  that  the  butterflies  containing  this  initial- 
group  should  be  place  into  STM(xj,/2,...,/£,_i) ,  where  x^  =  r..  The  order  of  the  set  of  the 
four  butterflies  in  STM(:,/2,...,/23_i)  defines  STM-EREE  (fit dimension). 

In  summary,  at  this  stage  one  can  obtain  any  distance  distribution  built  under 
Distance  Rule  1  by  defining  STM-EREE  (first  butterfly,  first  location,  part  of  left  side 
butterfly,  right  side  butterfly,  fit  dimension). 

Stage  3:  At  this  stage,  consider  any  wanted  distance  distribution  built  under  Distance 
Rule  2. 

These  16  paths  in  STM  are  in  Eigure  5.3  (a).  An  initial-group  is  located  along  the  fit 
dimension  and  a  terminal-group  is  located  along  the  2nd  dimension.  The  corresponding 
symbol  matrix  is  shown  in  Eigure  5.3  (b).  Regardless  of  different  codes,  the  symbol 
matrix  always  has  “  the  property  of  symbol  matrix”.  Erom  the  derivation  of  Distance 
Rule  2,  for  this  kind  of  symbol  matrix  we  do  not  need  know  the  actual  symbols  in  the 


107 


symbol  matrix;  only  the  reference-symbol’s  location  will  give  the  distances  of  all  the 
other  symbols  in  this  symbol  matrix. 

From  Lemma  5.1,  all  sets  of  four  butterflies  whose  location  indexes  satisfying 
X2  =  ^2  known.  From  Figure  5.3  (a),  there  is  one  and  only  one  set  of  4  butterflies 
containing  an  initial-group  that  should  be  placed  in  STM  with  Xj  =  •  So  comparing  the 

4  sets  of  4  butterflies  containing  these  four  initial-groups  with  all  sets  of  four  butterflies 
having  location  index  Xj  =  initial-group  will  be  recognized  that  should  be  placed 

in  STM  along  the  1st  dimension  and  have  location  index  Xj  =  d^.  Also,  STM-FREE  (1st 
dimension)  is  defined  in  the  previous  stage,  so  the  order  of  placing  the  set  of  four 
butterflies  containing  the  recognized  initial-group  along  the  1st  dimension  in  STM  is 
fixed.  Each  path  in  an  initial-group  belongs  to  a  different  terminal-group,  so  the  location 
indexes  of  the  four  terminal-groups  along  the  fit  dimension  in  Figure  5.3  (a)  are  known. 

Map  the  paths  in  STM  to  the  symbol  matrix;  this  recognized  initial-group  should 
be  placed  in  row  the  symbol  matrix.  The  column  indexes  of  the  four  terminal- 

groups  are  known  from  STM-FREE  (fit  dimension).  From  Lemma  5.2,  in  order  to  get 
any  wanted  distance  distribution,  all  the  other  three  initial-groups  will  be  uniquely  placed 
in  the  other  three  rows  of  the  symbol  matrix.  Map  to  STM;  the  butterflies  containing 
these  initial-groups  will  be  placed  uniquely.  Then  one  set  of  the  4  butterflies  along  the  2nd 
dimension  of  STM  will  define  STM-FREE  (2nd  dimension).  So  we  can  obtain  any  wanted 
distance  distribution  built  under  Distance  Rule  2  at  this  stage  by  defining  STM-FREE 
(2nd  dimension). 

Stage  4  to  D:  At  each  stage,  these  16  paths  in  STM  and  the  corresponding  symbol 
matrix  are  similar  to  those  at  stage  3.  Is  it  true  that  for  each  such  stage,  one  can  obtain 
any  wanted  distance  distribution  built  under  Distance  Rule  2  by  defining  one  more 
element  in  STM-FREE?  It  is  solved  in  Eemma  5.3. 

Lemma  5.3  For  any  stage  i,  3<  i<  D,  one  can  obtain  any  wanted  distance  distribution 
built  under  Distance  Rule  2.  By  obtaining  that,  STM-FREE  ((/-I);;,  dimension)  will  be 
defined. 
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Proof  by  induction  on  i . 

(1)  For  stage  /  =  3 ,  it  is  proved  above. 

(2)  Suppose  it  is  true  for  stage  i=k,  3<  k  <  D-\.  Then  for  stage  i=k  +  l,  these  16 
paths  in  STM  are  shown  in  Figure  5.4  (a).  An  initial-group  is  loeated  along  the  (k  - 
dimension  and  a  terminal-group  is  loeated  along  the  k,^  dimension.  The  eorresponding 
symbol  matrix  in  Figure  5.4  (b)  has  “the  property  of  symbol  matrix”.  There  is  one  and 
only  one  set  of  4  butterflies  containing  an  initial-group  that  should  be  placed  in  STM  with 
location  index  =  From  Lemma  5.1,  all  sets  of  four  butterflies  whose  loeation 
indexes  satisfying  =  4  are  known.  So  eomparing  the  4  sets  of  4  butterflies  eontaining 
these  four  initial-groups  with  all  sets  of  4  butterflies  having  loeation  index  =  4,  one 
initial-group  will  be  recognized  that  should  be  placed  in  STM  along  the  {k  - 
dimension  and  have  location  index  =4-  Also,  STM -FREE  ((k-l)^^  dimension)  is 
defined  in  the  previous  stage,  so  the  order  of  placing  the  set  of  four  butterflies  containing 
the  recognized  initial-group  along  the  {k  -  \)^f,  dimension  in  STM  is  fixed.  That  is  to  say, 
the  loeation  indexes  of  the  four  terminal-groups  along  the  {k  - 1)^^,  dimension  in  Eigure 
5.4  (a)  are  known. 

Map  to  the  symbol  matrix;  this  reeognized  initial-group  will  be  plaee  into  row  4 
and  the  eolumn  indexes  of  the  four  terminal-groups  are  known.  Erom  Lemma  5.2,  for  any 
wanted  distance  distribution,  the  other  three  initial-groups  will  be  uniquely  plaeed  in  the 
other  three  rows  of  the  symbol  matrix.  Map  baek  to  STM;  the  butterflies  eontaining  these 
initial-groups  will  be  placed  uniquely.  Then  one  set  of  the  4  butterflies  along  the 
dimension  in  STM  will  define  STM-EREE  dimension).  Eemma  5.3  is  proved. 

Stage  Z)  +  l:  these  16  paths  in  STM  are  shown  in  Eigure  5.5  (a).  An  initial-group  is 
loeated  along  the  {D  - 1)^^  dimension.  A  terminal-group  eonstitutes  a  simplex- 
transitiouD+i.  It  is  in  a  butterfly.  The  corresponding  symbol  matrix  has  “the  property  of 
symbol  matrix”.  The  row  indexes  and  the  eolumn  indexes  in  the  symbol  matrix 
eorrespond  to  the  four  internal  loeations  in  the  left  side  of  a  butterfly  and  the  four  location 
indexes  along  the  {D  - 1)^^  dimension  of  STM. 
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From  building  STM  in  Chapter  3,  we  know  that  the  internal  order  of  one  butterfly 
will  fix  the  internal  order  of  all  the  other  butterflies.  We  have  placed  the  originating  state 
g  of  the  reference-initial-group  at  stage  2  in  the  internal  location  k ,  where 
A:  g{1,  2,  3,  4},  in  the  left  side  of  the  anchor  butterfly.  Then  all  the  states  that  should  be 
placed  in  the  internal  location  k  in  the  left  side  of  all  the  other  butterflies  are  known. 

From  Figure  5.5  (a),  the  originating  states  of  one  and  only  one  initial-group 
should  be  placed  in  the  internal  location  k  of  the  four  butterflies  along  the 
(O- 1),;^  dimension  of  STM.  Compare  the  originating  state  sets  of  the  four  initial-groups 
with  all  the  states  that  should  be  placed  in  the  internal  location  k  in  the  left  side  of  all  the 
butterflies.  One  initial-group  will  be  recognized  whose  originating  states  should  be  placed 
in  the  internal  location  k  in  the  left  side  of  the  four  butterflies.  Since  the  previous  stage 
has  defined  STM-FREE  ((O  - 1)^;,  dimension),  the  order  of  placing  these  four  butterflies 
along  the  (O  - 1),^  dimension  is  fixed;  i.e.,  the  location  indexes  of  the  four  terminal- 
groups  along  the  (O  - 1)^^  dimension  are  known.  Map  the  paths  in  STM  to  the  symbol 
matrix;  this  recognized  initial-group  will  be  placed  in  row  k ,  and  the  column  indexes  of 
the  four  terminal-groups  are  known.  From  Lemma  5.2,  there  is  one  and  only  one  way  to 
place  the  other  three  initial-groups  in  the  other  three  rows  in  the  symbol  matrix.  Map 
back  to  STM;  the  originating  states  of  these  three  initial-groups  other  than  the  recognized 
initial-group  are  placed  uniquely  in  the  left  three  internal  locations  in  the  left  side  of  the 
four  butterflies  containing  these  16  paths.  This  will  fix  the  order  of  placing  the  other  three 
originating  state  other  than  the  state  g  in  the  left  side  of  the  anchor  butterfly;  i.e.,  the  rest 
part  of  STM-FREE  (left  side  butterfly)  that  has  not  been  defined  at  stage  2  will  be 
defined  at  this  stage. 

In  summary,  we  have  proved  that  when  building  a  distance  distribution  under 
Distance  Rule  1  and  Rule  2,  there  is  no  relationship  on  the  distance  distributions  between 
consecutive  stages.  At  each  stage  from  stage  2  to  stage  D  +  \,  any  distance  distribution 
built  under  Distance  Rule  1  and  Distance  Rule  2  is  a  valid  distance  distribution.  We 
further  showed  that  in  order  to  obtain  the  wanted  distance  distribution,  each  stage  will 
define  some  elements  in  STM-FREE.  At  stage  2,  STM-FREE  (first  butterfly,  first 
location,  part  of  left  side  butterfly,  right  side  butterfly,  fit  dimension)  will  be  defined,  at 


no 


stage  i,  3<i<D,  STM-FREE  dimension)  will  be  defined,  and  at  stage  D  +  l, 

the  rest  of  STM-FREE  (left  side  butterfly)  that  has  not  be  defined  at  stage  2  will  be 
defined. 


5.2,5  Build  Valid  Distance  Distributions  That  Can  Reach  Bounds 

This  section  will  build  valid  distance  distributions  that  can  give  the  bonds  of  the 
minimum  distance  of  HDTCM(4,Z)).  We  will  build  a  distance  distribution  from  stage  2 
to  Z)  + 1  under  Distance  Rule  1  and  Rule  2  specifying  the  distances  for  the  9  paths  P, , 
i  =  1,  2,  ,  9 ,  such  that  Equations  (5.4)  and  (5.5)  are  satisfied. 

Build  a  Valid  Distance  Distribution  to  Reach  the  Upper  Bound  on  the  Minimum 
Distance 


We  have  obtained 
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D  can  be  written  as  3m,  3m  + 1  or  3m +  2,  where  m  is  an  integer  and  m  >  0 ;  then 
can  be  rewritten  as 
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In  any  case,  m  =  [D  /  3J . 

For  m>l,  a  valid  distance  distribution  is  built  using  Procedure  5.1.  For  m  =  0,  it  is 
trivial,  we  will  deal  with  it  after  describing  Procedure  5.1. 


Procedure  5.1  Build  a  valid  distance  distribution  to  reach  the  upper  bound  on  the 
minimum  distance 

1.  Build  one  path— say  path  Pj— such  that  .  First,  place  distance  4  in  each  stage 

from  stage  2  to  D  -l- 1 ;  this  will  contribute  AD  to  .  Then  add  distance  4  to  stage  2, 
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and  add  distance  2  (if  Z)  =  3m  +  2  )  in  any  one  stage  between  stage  3  and  stage  D  +  \. 
The  largest  distanee  for  a  path  at  stage  2  is  8,  at  the  other  stages  is  6.  So  stage  2  is  now 
eompleted.  There  left  D-l  or  D-2  (if  D=3m  +  2)  stages  having  distanee  4;  these 
stages  ean  only  be  added  distanee  2  in  eaeh  stage.  In  order  to  obtain  Z/j  =  ,  the  left 

distanee  to  be  distributed  is  4D  +  4m  -  4D  -  4  for  D=  3m  or  Z)  =  3m  + 1  and  is 
4D  +  4m  +  2  -  4D  -4-2  for  D  =  3m  +  2  .  In  both  oases,  it  is  2(2(m  - 1))  >  0  when 
m  >  I .  They  need  to  be  distributed  to  2(m  - 1)  different  stages  with  distanee  2  at  eaeh 
stage.  For  any  D ,  it  ean  be  verified  that  2(m  - 1)  <  Z)  -  2 ;  i.e.,  there  are  enough  stages 
having  distanee  4  so  far  that  ean  be  added  distanee  2  at  eaeh  of  those  stage.  So, 
seoondly,  we  add  distanee  2  to  any  2(m  - 1)  stages  among  the  stages  having  distanee  4 
so  far.  Path  Pj  is  now  eompleted  and  has  .  (See  Figures  5.7  (a)  and  (b).) 


Hmax  =4D  +  4m,  D  =  3mOr  D  =  3m  +  l  =4D  +  4m  +  2,  D  =  3m  +  2 


Stage  2  3 

D+1  4  4  ...  4  4  ...  4 
4 

8  6  ...  6  4  ...  4 


stage  2  3 

D+1  444...  44...  4 


2(m-l)  D-l-2(m-l) 


2(m-T)  D-2-2(m-l) 


(a) 


(b) 


Figure  5.7  Build  the  distance  distribution  to  reach  the  upper  bound  on  the  minimum 
distance  for  HDCTCM(4,  D)  (a)  the  first  path  for  D  =  3m  or  D=  3m  + 1  (b)  the  first  path 

for  D  =  3m  +  2 


2.  Under  Distanee  Rule  1  and  Rule  2,  build  two  other  paths— say  path  Pj  and  P3— that  in 
the  same  initial-group  as  path  Pj.  At  stage  2,  path  Pj  has  distanee  8;  the  distanee 
should  be  4  in  both  paths  Pj  and  P3 .  For  the  stages  that  Pj  has  4,  both  Pj  and  P3 
should  have  distanee  6.  For  the  stages  at  whieh  path  Pj  has  distanee  6,  one  of  the  path 
among  P2  and  P3  should  have  distanee  4  and  the  other  one  should  have  distanee  6.  For 
any  D,  there  are  at  least  2(m-l)sueh  stages;  let  eaeh  of  the  paths  P2  and  P3  has 
distanee  4  at  m-lstages  and  distanee  6  at  the  other  m-lstages.  For  D=3m  +  2, 
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there  is  one  more  stage  at  whieh  path  Pj  has  distanee  6.  For  this  stage,  let  any  one  of 
paths  Pj  and  P3  have  distanee  4  and  the  other  one  have  distanee  6.  These  three  paths 
are  shown  in  Figures  5.8  (a)  and  (b). 
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^max 

=  4Z)  +  4m  +  2  ,  D  -  3m  +  2 
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Figure  5.8  Build  the  distance  distribution  to  reach  the  upper  bound  on  the  minimum 

distance  for  HDCTCM(4,Z))  (a)  the  three  paths  in  an  initial-group  for  D  =  3m  or 
D  =  3m  + 1  (b)  the  three  paths  in  an  initial-group  for  D  =  3m  +  2 


For  Z)  =  3m  ovD  =  3m  + 1 , 

f  D=3m 

M  =//,  =  4  +  10(m-l)  +  6(Z)-l-2(m-l))  =  4Z)+4m+2Z)-6m=^ 

^  ^  l^.ax  +  2,  T»=3m  +  1 

(5.8) 

For  D  =  3m  +  2 , 

=4+4+10(m-l)  +  6(Z)-2-2(m-l))=4Z)  +  4m  +  2  =  //„,^ 

(5.9) 

7/3  =  4  +  6  + 1 0(m  - 1)  +  6(Z)  -  2  -  2(m  -  1))  =  4Z)  +  4m  +  2  =  +  2  . 

(5.10) 

3.  Build  the  other  two  sets  of  three  paths;  eaeh  set  belongs  to  one  of  the  other  two  initial- 
groups.  Interehange  the  distance  distribution  of  the  three  paths  Pi,P2,  and  P3  and 
assign  them  to  the  three  paths  in  the  other  two  initial-groups.  The  interchange  is  done 
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in  such  a  way  that  each  initial-group  (terminal-group)  has  distanee  distributions  of 
Pj,P2,  and  P3,  and  the  path  that  has  distanee  distribution  of  P,,  i  =  1,  2,  3  in  eaeh 
initial-group  (terminal-group)  belongs  to  a  different  terminal-group  (initial-group). 
Suppose  the  other  initial-groups  are  {P4,P5  and  Pg}  and  {P7,P8  and  Pg}.  {Pj,P4,P7}, 
{Pj  ,P5,P8}  and  {P3,Pg,Pg}  are  the  three  terminal-groups.  Then  let  P4  ,P5,  and  Pg  have 
the  same  distanee  distributions  as  that  of  Pj  ,P3,  and  Pj,  respeetively  and  let  P7,P8,  and 
Pg  have  the  same  distanee  distributions  as  that  of  P3,Pi,  and  Pj ,  respeetively.  Then  it 
ean  be  verified  that  eaeh  initial-group  (terminal-group)  has  one  speeial-8-path  at  stage 
2  or  one  speeial-4-path  at  eaeh  stage  from  stage  3  to  Z)  + 1 ,  and  the  speeial-8-path  or 
the  speeial-4-path  from  eaeh  initial-group  (terminal-group)  belongs  to  a  different 
terminal-group  (initial-group),  i.e.,  Distanee  Rule  1  and  Rule  2  are  satisfied.  Also,  for 
the  9  paths,  P.,  i  =  1,  2,  ...  ,  9  ,  Equations  (5.4)  and  (5.5)  are  satisfied. 

When  m  =  0,  D=\  or  D  =  2.  For Z)  =  1 ,  =  4D+  4m  =  4  .  There  is  only  one  stage- 

stage  2— whieh  needs  to  build  distance  distribution.  The  first  three  paths  Pj ,  P2  and  P3 , 
ean  have  distanee  4,  8  and  4  at  this  stage,  respeetively. 

For  D=2,  =  4D+  4m  +  2  =  10  .  There  are  two  stages— stage  2  and  3— whieh 

needs  to  build  distanee  distribution.  The  distanee  distributions  ean  be  built  as  follows.  At 
stage  2  and  3,  Pj  has  distanee  4  and  6,  P2  has  distanee  8  and  4,  and  P3  has  distanee  4  and 
6. 

Following  step  3  in  Proeedure  5.1,  the  distanee  distribution  of  all  the  other  paths 
ean  be  obtained. 

It  ean  be  verified  that  Distanee  Rule  1  and  Rule  2  are  satisfied.  Also,  for  the  9 
paths,  P, ,  /  =  1,  2,  ...  ,  9 ,  Equation  (5.4)  and  (5.5)  are  satisfied. 

So,  for  all  D,  we  have  built  a  valid  distanee  distribution  that  can  achieve  the 
upper  bound  on  the  minimum  distanee  of  HDCTCM(4,D). 
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Build  a  Valid  Distance  Distribution  to  Reach  the  Lower  Bound  on  the  Minimum 
Distance 

For  lower  bound,  H  ■  =AD.  First  build  a  path  P,  that  satisfies//,  =  H-.  This 

path  has  distance  4  at  each  stage  from  stage  2  to  D  +  \.  Then  the  other  two  paths  in  the 
same  initial-group  as  path  Pj  is  easy  to  built  under  Distance  Rule  1  and  Rule  2.  The  three 
paths  are  shown  in  Figure  5.9.  Following  the  step  3  in  Procedure  5.1,  the  distance 
distributions  of  all  the  other  paths  can  be  obtained.  It  can  be  verified  that  Distance  Rule  1, 
Rule  2,  and  Equations  (5.4)  and  (5.5)  are  satisfied. 

H  ■ 
mm 

stage  2  3  ...  D+1 

Pi  4  4  ...  4 

P2  8  6  ...  6 

P3  4  6  ...  6 

Figure  5.9  Build  the  distance  distribution  for  the  three  paths  in  an  initial-group  to  reach 
the  lower  bound  on  the  minimum  distance  for  HDCTCM(4,D) 


So  far,  valid  distance  distributions  have  been  built  that  can  reach  the  bounds.  In 
other  words,  we  have  proved  that  the  bounds  on  the  minimum  distance  can  be  reached. 

5,3  Optimum  Distance  Codes 

When  a  code  achieves  upper  bound  of  the  MD  of  its  kind,  this  code  is  called  an 
optimum  distance  code.  This  section  will  give  the  method  to  built  an  optimum  distance 
code  and  show  the  possible  distance  distributions  for  an  optimum  distance  code. 

5,3.1  Build  Optimum  Distance  Codes 

In  the  proof  of  Theorem  5.1,  we  actually  describe  the  procedure  to  obtain  a  STM 
that  will  give  any  wanted  distance  distribution  built  under  Distance  Rule  1  and  Rule  2. 
Then  the  way  to  build  an  optimum  code  or  a  code  that  has  the  lower  bound  on  the 
minimum  distance  is  described  as  follows. 
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Procedure  5.2  Build  an  optimum  distance  code  or  a  code  that  has  the  lower  bound  of  the 
minimum  distance 

1.  Using  the  method  in  described  in  Section  5.2.5,  build  a  valid  distance  distribution  that 
can  give  the  upper  or  lower  bounds  on  the  minimum  distance. 

2.  Following  the  proof  of  Theorem  5.1,  obtain  the  distance  distribution  built  in  step  1 
from  stage  2  to  stage  Z)  + 1  by  defining  some  elements  in  STM-FREE  at  each  stage. 
This  STM-EREE  will  fix  a  STM.  Then  map  the  signal  constellation  to  this  STM;  the 
symbol  assignment  can  be  obtained.  The  code  using  this  symbol  assignment  will  reach 
the  bounds  on  the  minimum  distance. 


5,3,2  Possible  Distance  Distributions  for  Optimum  Distance  Codes 

The  method  described  in  Section  5.2.5  is  not  the  only  way  to  build  a  valid 
distance  distribution  that  can  reach  the  bounds.  But  all  the  valid  distance  distribution  that 
can  reach  the  bounds  must  satisfy  Equations  (5.4)  and  (5.5).  So  there  are  limited  numbers 
of  distance  distribution  patterns  which  exist  for  the  optimum  distance  codes. 

Among  the  9  paths,  P, ,  /  =  1,  2,  ... ,  9 ,  Suppose  ,  y  =  1,  2,  3  are  the  three  paths 


in  any  one  initial-group  or  any  one  terminal-group.  Prom  Distance  Rule  1  and  Rule  2,  it 

3 

can  be  verified  that,  ^  ZZy  =  16Z) ,  for  any  D . 

j=i 

There  are  three  cases  for  D . 

(1)  Por  D=3m, 

=  4D+ 4m  =  4  ■3m  + 4m  =  \6m  (5.11) 

X//-16D=3-16m=3-//_  (5.12) 

7  =  1 

So  in  order  to  satisfy  Equations  (5.4)  and  (5.5),  the  set  of  distances  Hj  of  the  three  paths 
P^  should  be  .  Then  the  distances  of  the  9  paths,  P, ,  /  =  1,  2,  ... ,  9 , 

are  shown  in  Pigure  5.10. 


TT  TT  TT 

^  max  ^  max  ^  ^  max 


TT  TT  TT 

^  max  ^  max  ^  ^  max 


TT  TT  TT 

^  max  ^  max  ^  ^  max 
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Figure  5.10  The  distances  H.  of  the  9  paths,  P,  ,  i  =  1,  2,  ,  9 ,  for  optimum 

HCTCM(4,£))  codes  with  D=  3m 


In  Figure  5.10,  each  row  represents  the  distances  H.  of  the  three  paths  in  an 
initial-group  and  each  column  represents  the  distances  H-  of  the  three  paths  in  a  terminal- 
group.  It  can  be  seen  that  in  the  optimum  distance  codes,  for  the  9  paths  P,  , 
/  =  1,  2,  ...  ,  9 ,  their  distances  are  all  equal  to  16  . 


(2)  For  D=3m  +  \ 

//jjjax  =  ^D+  4m  =  4  ■3m  +  4  +  4m  =  16m  +  4  (5.13) 

f^H.  =  \6D  =  16-  (3m  + 1)  =  3  •//_  +4  (5.14) 

7  =  1 

So  in  order  to  satisfy  Equations  (5.4)  and  (5.5),  the  set  of  distances  H.,  of  the  three  paths 
P.  should  be  or  .  Then  the  possible 

distances  H.  of  the  9  paths,  P,. ,  /  =  1,  2,  ...  ,  9 ,  are  shown  in  Figure  5.11. 
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Figure  5.11  The  distances  H.  of  the  9  paths,  P,  ,  i  =  1,  2,  ...  ,  9 ,  for  optimum 
HCTCM(4,Z))  codes  with  D  =  3m  + 1 


In  the  optimum  distance  codes,  for  the  9  paths  P.,  i  =1,  2,  ...  ,  9,  in  Figure  5.11 
(a),  there  are  6  paths  having  distance  \6+H^^+2  and  3  paths  having  distance 
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16  +//jnax- Figure  5.11  (b),  there  are  3  paths  having  distance  16  +4  and  3  paths 

having  distance  In  Figure  5.11  (c),  there  are  4  paths  having  distance 

\6  +  H^^+2 ,  one  path  having  distance  \6  ,  and  4  paths  having  distance 


It  can  be  seen  that  in  the  optimum  distance  codes,  for  the  9  paths  P,  , 
i  =\,  2,  ...  ,  9,  there  are  3  paths  having  distance  \6  and  6  paths  having 

distance  16  . 
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CHAPTER  6  DECODING  AND  ERROR  PERFORMANCE 
OF  HDCTCM 


This  chapter  will  address  the  decoding  algorithms  for  HDCTCM.  Circular  BCJR 
algorithms  are  investigated  for  deeoding  HDCTCM.  In  Seetion  6.1,  the  problems  in 
practical  implementation  of  cireular  BCJR  and  solutions  to  them  are  discussed;  then  in 
section  6.2,  an  iterative  cireular  shift  BCJR  is  developed  for  deeoding  HDCTCM.  In 
Seetion  6.3,  the  properties  of  this  deeoding  algorithm  are  demonstrated  through 
simulations  and  eompared  with  other  decoding  algorithms.  Finally,  the  error  performance 
of  HDCTCM  using  this  deeoding  algorithm  is  presented  in  Seetion  6.4. 

6,1  Problems  in  Practical  Implementation  of  Circular  BCJR 

BCJR  and  circular  BCJR  are  introduced  in  Seetion  2.4;  we  will  employ  all  the 
denotations  and  terms  introduced  there.  Derivation  of  eireular  BCJR  for  tail  biting  codes 
is  based  on  Equation  (2.27).  All  eireular  trellis  eodes  satisfy  this,  as  does  HDCTCM.  In 
this  seetion,  we  will  explore  the  cireular  BCJR  for  deeoding  of  HDCTCM.  First, 
implementation  problems  need  to  be  solved  to  actually  implement  these  algorithms.  In 
HDCTCM (n,D),  the  total  number  of  states  is  S=n^  and  the  information  sequence 
length  is  denoted  as  L.  In  eireular  BCJR  with  eigenveetors,  eigenvectors  of  the 
multiplication  of  a  sequence  of  matrixes  need  to  be  caleulated,  where  is  an 

S  X  S  matrix,  t  =  1,...,L.  Each  element  in  y^is  a  probability.  The  elements  in  can 

be  extremely  small  for  a  reasonably  large  L,  and  due  to  this,  the  eigenveetors  of  this 
matrix  will  not  eonverge.  When  the  values  of  elements  in  beeome  so  small  that 

the  computer  does  not  have  enough  preeision  to  represent  them,  they  will  simply  be 
treated  as  zero.  This  will  cause  Yi-.-Yi  to  be  a  matrix  with  all  zeros  and  the  eigenveetors 
obtained  will  not  be  correet. 

Our  solution  to  this  problem  is  as  follows:  when  calculating  YvYl^  scale  yi...y; 
whenever  it  is  getting  too  small  and  multiply  this  scaled  value  with  y^+ito  get  yj...y,_|_j. 
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Because  what  we  want  is  the  normalized  eigenvectors  of  scaled  will  have 

scaled  eigenvectors,  and  normalizing  the  scaled  eigenvectors  will  give  the  same  results  as 
normalizing  the  unsealed  ones.  With  this  solution,  the  normalized  eigenvectors  of 
y^.-.yi  can  be  calculated  for  any  large  L  and  S . 

Large  delay  in  decoding  will  be  incurred  by  the  normalization  of  «,andy0,  at  each 
trellis  stage  and  for  each  iteration  (in  iterative  circular  BCJR)  in  circular  BCJR,  when  L 
is  reasonably  large.  The  normalization  is  introduced  previously  to  control  the  calculation 
precision.  But  in  order  to  control  computation  precision,  the  normalization  of  and  f5^ 
is  only  necessary  at  stages  when  they  are  getting  too  small.  We  call  this  “selective 
normalization”.  In  iterative  circular  BCJR,  the  iterations  stop  when  the  difference  on  a 
between  consecutive  and  (r  - 1),^  iterations,  >  is  sufficiently  small,  by 

a  suitable  measure,  for  all  t,  t  =  l,...,L.  The  superscript  "o"indicates  the  normalized 
vectors.  This  requires  a  to  be  normalized  at  each  trellis  stage  t  in  every  iteration.  When 
“selective  normalization”  is  employed,  a  is  only  normalized  at  stages  when  it  is  getting 
too  small;  this  stop  condition  should  be  modified  accordingly.  Since  the  speed  for 
al^,,a2L+,,---,cCrL+t  to  converge  to  a°  is  the  same  for  all  t,  t  =  l,...,L,  we  can  choose 
one  stage  from  the  total  L  stages,  normalize  a  at  this  stage  no  matter  it  is  too  small  or 
not,  and  compare  the  difference  of  a°  at  this  stage  between  consecutive  iterations  to 
decide  if  more  iterations  are  needed.  Without  loss  of  generality,  stage  L  is  chosen. 
Define  A  =  max(afc(«°^  -  ,  where  "ahf  means  the  absolute  value;  then  when  A 

is  sufficiently  small,  stop  the  iteration  and  the  set  of  a  vectors  is  obtained  at  the 
iteration.  A  similar  argument  holds  for  iterations  on  [5 . 

Although  the  eigenvectors  of  y^.-.y^  can  be  obtained  for  any  large  L  and  S .  The 
computation  load  to  obtain  it  is  much  larger  than  that  involved  in  iterative  circular  BCJR 
with  several  iterations— especially  for  large  L  and  S .  The  circular  BCJR  with 
eigenvectors  is  served  more  as  a  theoretical  basis  to  derive  the  iterative  circular  BCJR 
than  to  be  implemented  practically.  For  practical  decoding  of  HDCTCM,  iterative 
circular  BCJR  will  be  investigated. 
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6.2  Iterative  Circular  Shift  BC  JR  for  HDCTCM 


The  initial  a^and  (5^  needs  to  be  set  in  order  to  run  the  iterative  cireular  BCJR. 
Some  choices  will  lead  to  faster  convergence  than  others  will.  In  this  section,  we 
introduce  a  scheme  based  on  the  statistical  estimate  of  the  starting  state  on  the 
observation  of  the  received  sequence.  In  this  scheme,  the  reliability  of  the  estimation  is 
defined  and  used  to  select  the  most  reliable  symbol  in  the  received  sequence.  Also,  the 
circular  property  of  HDCTCM  will  be  incorporated  to  make  this  most  reliable  symbol  as 
the  starting  point  in  the  decoding. 


6.2,1  Statistic  Estimation  of  Starting  State  in  HDCTCM 

First  let  the  receiver  tentatively  hard  decode  each  symbol  in  the  received  sequence 
=  Y^,Y2,...,Y^  .  On  the  observation  of  the  decoder  hard  decodes  it  to  X^,  where 
belongs  to  the  channel  signal  constellation.  For  the  situation  that  all  channel  symbols  are 
equally  likely,  which  is  true  for  HDCTCM,  we  have  shown  in  Section  2.4  that  in  order  to 
minimize  the  probability  of  making  an  erroneous  decision,  the  receiver  should  choose  X^ 
such  that 

P(Tji;)=  ma^P{l\X)  (6.1) 

over  all  X 


In  an  Adimensional  space,  where  N  is  the  space  dimension  of  signal 
constellation  for  HDCTCM  (n,D),  channel  symbol  X  and  }(are  represented  as 
X  =  (xi,x2,...,x^)  and  ’  then  for  a  discrete  memoryless  AWGN 

channel  with  one-sided  noise  spectrum  density  Ag , 


P{YAX)  = 


1 


N  .  (y,t-xX 

—  e 

k=l  0 


N 

n 


(6.2) 


\  -  a||  is  the  squared  Euclidean  distance  between  Y^  and  X . 

The  larger  F’(TJAJ)is,  the  smaller  is  the  likelihood  of  making  an  error  when 
decoding  Y,  to  X,,  i.e.,  the  more  reliable  is  this  decision.  We  define  P{Y,\X,)  as  the 
reliability  of  decoding  Y^  to  A^or  simply  the  reliability  of  symbol  Y^.  In  this  way,  the 
receiver  decodes  to  X^  =  Aj,A2,...,A^  with  reliability  information  P(Y^  \  XJ  for  each 
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t.  Compare  P{Y^  \  X^)  for  all  t,  find  the  largest  one — say,  P{Y.  \  then  Y^  is  the  most 

reliable  symbol.  Denote  the  state  transition  to  be  assigned  X.  is  m  m  ,  m  and  m  are 

two  trellis  states.  If  we  eireular  shift  I^^to  let  I^be  the  first  symbol  in  the  shifted 

iSHlFT(i)  ... 

sequenee,  denoted  as  Y^  =  then  when  running  iterative 

eireular  BCJR  on  initial  ean  be  set  as 


[  1,  m  =  m 
aJm)  =  i 

I  0,  otherwise 


y^^is  set  as  same  as  initially. 


(6.3) 


6,2.2  Circular  Property  of  HDCTCM  and  Iterative  Circular  Shift  BCJR 

The  eireular  property  of  trellis  path  in  HDCTCM  will  be  used  to  seleet  the  most 
reliable  symbol  in  Y^  as  the  starting  point  for  deeoding.  Denote  the  information  sequenee 
as  U  =  {U^,U2,...,U,,--;Ui) ,  where  U.  belongs  to  the  finite  information  symbol  alphabet. 
The  eorresponding  starting  state  is  So,  and  the  state  transition  sequenee  is 
Sq  ^  Si  ^  S2  ^  ...  Si_i  S,  ^  -^Sq.  The  eorresponding  eode  sequenee  is 

denoted  as  V  =  (f^, I^,...,Fp...,Fy^)  where  belongs  to  the  ehannel  signal  constellation. 
The  permuted  state  transition  table  employed  by  HDCTCM  guarantees  that  a  circular 
shift  version  of  U ,  denoted  as  will  have  a  state 

transition  sequence  and  a  code  sequence  which  are  the  circular  shift  versions  of  those  for 
U .  The  state  transition  sequence  will  be 

S^_i  — ^  ^  ...  — ^  ^  ^0  — ^  ^1  — ^  ***  — ^  ^t-2  — ^  .  ^rid  the  code  sequence  wdl  be 

ySHIFT(t)  y  V  V  V  V  ) 

'  \'t’  't+l’---’  'L’  '1’  't-\)  ■ 

Therefore,  if  we  can  decode  the  circular  shift  version  of  receive  sequence, 
^iSHiFT(i)  ^  and  get  information  sequence  U ,  then  decoding  of  Y^  will  give  a  circular  shift- 

back  version  of  U ,  i.e.,  _  As  discussed  in  the  previous  section,  the  initialization 

problem  for  decoding  Y^  using  iterative  circular  BCJR  is  solved.  We  name  this 
scheme  of  running  iterative  circular  BCJR  on  the  circular  shift  version  of  received 
sequence  and  the  corresponding  way  to  set  initial  and  y^^as  iterative  circular  shift 
BCJR  algorithm  for  decoding  HDCTCM. 
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For  decoding  HDCTCM(n,Z)) ,  the  symbols  in  information  sequence  are  directly 
related  to  state  transitions  other  than  related  to  the  states  in  shift  register  based  trellis 
coding.  Therefore,  we  only  need  to  calculate  cr’s  in  the  iterative  circular  shift  BCJR.  Let 
be  the  set  of  transitions  =m  S^=m  caused  by  input  symbol  j ,  where  j 
belongs  to  the  information  symbol  alphabet.  Then  after  <j^{m  ,m)  is  obtained,  the 
probability  of  the  input  symbol  at  stage  t  is 


/’(t',  =yiy)=  ' 


Yj  (jXm,m)  = 

(m',m)eC® 


1 


^  ,  ^)  (m’ ,m)eC® 

all  (m  ,m) 


^  aXm  ,m) 


(6.4) 


We  decode  U,  =  j  such  that 

P{U,  =j  I  yX)  =  m^xP{U,  =  j  I  yX)  (6.5) 


Some  other  parameters  in  iterative  circular  shift  BCJR  for  decoding  HDCTCM(n,Z))  are 
specified  as  follows. 

For  the  calculation  of  y,  in  (2.23),  we  have 

\\  !  n  ,  if  transition  m'  ^  m  is  allowed  at  stage  t 
1 0,  otherwise 


P{S^  =  m\S,  =  m)=' 


(6.6) 


Denote  the  channel  symbol  assigned  to  transition  m  ^  m  as  we  have 

\  1,  X=X<“’”’) 

P{X=X,S=m\S,,=m)  =  <  (6.7) 

[O,  otherwise 

In  implementation,  YXm,m)is  stored  as  a  sparse  matrix  only  for  m  and  m where 
transitionm  ^  m  is  allowed  in  order  to  reduce  the  computation  load  and  memory  usage. 


6,2,3  Basic  Steps  of  Iterative  Circular  Shift  BCJR  Decoding 

Now,  we  can  summarize  the  basic  steps  for  the  decoding  of  HDCTCM  using 
iterative  circular  shift  BCJR.  “Selective  normalization  ”  and  modified  stop  condition  for 
iterations  are  included  here  as  well. 

Given  Y^  =Y,J^,...,Yp. 
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1.  Hard  decode  l^^to  =Xj,X2,...,X^  and  find  the  most  reliable  symbol  Y..  Denote 

the  state  transition  to  which  X.  is  assigned  as  m  ^  m  .  Circular  shift  to 
^iSHiFT(i)  _  YJ^,Y^,  Fj, •••,  •  Decode  in  the  following  steps. 

2.  Set  initial  «q  as  in  Equation  (6.3). 

3.  Set  iteration  count  r  =  1 .  Calculate  a  set  of  «^2.+o-  •  <^(r+i)L  by 

=  t  =  \,...,L  (6.8) 

using  =  y, .  (6.9) 

Normalize  a^2.+r  uuly  when  it  is  too  small  ox  t  =  L  using 

=  (6-10) 

/ 

Calculate  A  =  xnayi{abs{al^  -  a(°_i)i)) ,  when  A  is  sufficiently  small,  stop  and  the  set 
of  a  vectors  is  obtained  as  =  t  =  l,...,L,  Otherwise,  r  =  r  +  \,  repeat  the 
iteration. 

4.  Execute  a  similar  procedure  backward  along  the  trellis  circle  to  find  the  set  f3°^  ...  Pi. 
Set  =  «o  initially. 

5.  Calculate  cr,(m  ,  m)using  Equation  (2.20) 

6.  Decode  the  information  sequence  using  Equations  (6.4)  and  (6.5),  denoted  as  U ,  then 
the  original  information  sequence  corresponding  to  Y^"  is 

6.2,4  Calculate  Bit  Error  Probability  for  HDCTCM(w,  Z)) 

Eor  simulations  of  decoding  using  iterative  circular  shift  BCJR  on 
HDCTCM(n,D)  codes,  bit  error  probability  needs  to  be  calculated.  This  can  be  done  in 
two  ways. 

In  the  first  method,  decode  the  symbol  in  information  sequence  at  each  stage,  and 
rewrite  each  symbol  as  logj  n  bits. 

The  second  method  is  to  decode  each  of  the  logj  n  bits  in  each  symbol  at  each 
stage.  This  can  be  done  by  establishing  the  relationship  between  the  bits  in  the  symbol 
and  the  state  transitions  at  that  stage.  Eor  example,  for  HDCTCM(4,D),  the  information 
symbol  alphabet  is  {0,1, 2, 3}.  Symbols  0  and  1  have  bit  0  at  the  first  place  and  symbol  0 
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and  2  have  bit  0  at  the  seeond  plaee.  Rewrite  eaeh  symbol  in  the  information  sequenee  Li¬ 
as  two  bits  .  Similar  to  Equation  (6.4),  we  have 

1 


V  /  Z  cj,{m,m) 

2-1  (in'  ,m)e(C*">  uC*'*) 


all  (m  ,m) 


=  0  |f;^)  =  - 


■"V - ^ ^  Z  cr,(m',m) 

2-1  ■>  (m'  .HiXC'"’  uC*^> ) 


(6.11) 


(6.12) 


all  (m  ,m) 


We  deeode  17^^'  =  0 ,  k=l ,2,  if  P{U\’'^  =  0  1 1)^)  >  0.5 ,  otherwise  =  1 . 

The  bit  error  probability  in  simulation  is  the  number  of  different  bits  between  the 
deeoded  information  sequenee  and  the  information  sequenee  inputted  to  the  eneoder  over 
total  number  of  bits  in  the  information  sequenee.  Since  these  two  methods  both  relate 
their  decoding  events  to  the  APP  of  state  transitions  at  each  stage,  there  should  be  no 
significant  difference  between  the  resultant  bit  error  probabilities.  Figure  6.1  shows  the 
bit  error  probability  for  decoding  a  HDCTCM(4,2)  code  with  information  length  L=16 
using  iterative  circular  shift  BCJR.  Eb/No  is  the  average  bit  energy  per  noise  power 
spectrum  density.  The  “decode  by  symbol”  and  “decode  by  bit”  refer  to  the  first  and 
second  method,  respectively. 
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Figure  6.1  Bit  error  probability  of  decoding  a  HDCTCM  (4,2)  code  with  L=16  using 
iterative  circular  shift  BCJR,  for  two  different  error  bit  probability  calculation  methods 


6,3  Properties  of  Iterative  Circular  Shift  BCJR  Decoding 

In  this  section,  simulation  results  are  given  to  explore  the  properties  of  iterative 
circular  BCJR  decoding  algorithm.  Also,  comparisons  with  other  decoding  algorithms  are 
presented. 

6,3,1  Comparison  with  Circular  BCJR  with  Eigenvectors 

We  have  argued  that  the  computation  load  for  circular  BCJR  with  eigenvectors  is 
much  larger  than  the  iterative  circular  BCJR  for  large  trellis.  Tables  6.1  and  6.2  show  the 
execution  time  spent  by  CPU  for  decoding  HDCTCM (4, ZJ) codes  with  L  =  \6  at 
E  E 

—  =-\  dB  and  —  =  -2  t/Busing  these  two  algorithms.  The  stop  condition  used  by 

N,  N, 

iterative  circular  shift  BCJR  is  A<10^^^\  Execution  time  is  accumulated  over  100 
information  sequences.  Time  unit  is  seconds.  Simulations  are  written  in  Matlab  running 
on  a  DEC-alpha-600MHz  workstation.  It  can  be  seen  that  the  difference  between  the 
execution  times  is  getting  larger  when  trellis  depth  D  is  increased. 


Table  6.1  Execution  Time  of  Decoding  HDCTCM (4,  ZJ)  Codes  Using  Different  Circular  BCJR 
Algorithms  at  Eb/No=-l  dB 


Trellis  depth  D 

Circular  BCJR  with 

Iterative  circular  shift 

eigenvectors 

BCJR  (A  <  10^ 

2 

2.48 

2.87 

3 

18.51 

11.97 

4 

763.60 

164.10 

5 

148294.00 

4711.00 
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Table  6.2  Execution  Time  of  Decoding  HDCTCM(4,£))  Codes  Using  Different  Circular  BCJR 
Algorithms  at  Eb/No=2  dB 


Trellis  depth  D 

Circular  BCJR  with 

eigenvectors 

Iterative  circular  shift 

BCJR(A<10‘ 

2 

2.34 

2.5100 

3 

18.14 

9.8600 

4 

735.49 

111.4900 

5 

147336.00 

3615.00 

Figures  6.2  and  6.3  show  the  bit  error  probability  of  decoding  a  HDCTCM(4,2)  code  and 
a  HDCTCM(4,3)  code  using  these  two  schemes.  These  figures  show  that  at  stop 
condition  A  the  set  of  a’s  and  P's  in  iterative  circular  shift  BCJR  converge 

close  enough  to  those  obtained  by  circular  BCJR  with  eigenvectors  to  make  almost  the 
same  decode  decision. 
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Figure  6.2  Bit  error  probability  of  decoding  a  HDCTCM  (4,2)  code  with  L=16  for  different 

decoding  schemes 


Figure  6.3  Bit  error  probability  of  decoding  a  HDCTCM  (4,3)  code  with  L=16  for  different 

decoding  schemes 
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6,3.2  Convergence  Property  of  Iterative  Circular  Shift  BC  JR  Algorithm 

The  speed  of  convergence  for  iterative  circular  BCJR  is  affected  by  the 
initialization  of  and  and  the  stop  condition  for  the  iterations.  The  convergence 
property  of  iterative  circular  shift  BCJR  is  investigated  here.  For  comparison,  an  iterative 
circular  BCJR  using  a  different  initialization  is  chosen  as  a  reference  decoding  scheme.  In 
this  reference  scheme,  since  a  legal  path  can  start  and  end  at  one  of  all  the  possible  states 
with  equal  possibility  in  HDCTCM(n,Z)) ,  in  the  absence  of  better  knowledge,  simply  set 
initial  ttg  and  as  follows: 

ao(m)  =  =  ^  ,  for  all  state  m  (6.13) 

n 

Then  decode  the  received  sequence  (not  shift  version)  using  the  iterative  circular  BCJR. 
The  number  of  iterations  required  for  these  two  schemes  is  compared. 

Simulations  are  done  on  a  HDCTCM(4,3)  code  with  L=16.  Figures  6.4  and  6.5 
show  the  number  of  iterations  required  by  a  and  y9in  these  two  decoding  schemes  both 
at  stop  condition  A  <  10^^^^ .  “Equally  likely  initialization”  refers  to  the  reference  scheme. 
The  number  of  iterations  is  averaged  over  10,000  information  sequences.  For  low 
/  Nq,  the  estimation  of  starting  state  in  iterative  circular  shift  BCJR  is  no  better  than 
the  simple  initialization  in  the  reference  scheme,  but  for  medium  and  high  /  Nq,  the 
estimation  of  starting  state  leads  to  faster  convergence  than  the  reference  scheme.  For 

—  >2  dB,  no  more  than  two  iterations  are  needed  to  converge  at  A  <10*^^*  for  both 

N, 

schemes. 
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-2  0  2  4  6  8 

E,/N„  (dB) 


Figure  6.4  Number  of  iterations  required  by  a  for  decoding  a  HDCTCM(4,3)code  using 

/•2\ 

different  decoding  schemes  at  A  <  10 


-2  0  2  4  6  8 

Eb'No(dB) 


Figure  6.5  Number  of  iterations  required  by  for  decoding  a  HDCTCM(4,3)code  using 

/•2\ 

different  decoding  schemes  at  A  <  10 


Figure  6.6  shows  the  bit  error  probability  of  deeoding  this  code  using  these  two 
decoding  schemes.  All  these  figures  show  iterative  circular  BCJR  forgets  an  erroneous 
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starting  and  (3^  very  rapidly  and  converge  to  the  objective  steady  value  after  just 
several  iterations. 


Figure  6.6  Bit  error  probability  of  decoding  a  HDCTCM  (4,3)  code  with  L=16  for  different 

/_-i\ 

decoding  schemes  at  A  <  10 

Also,  for  iterative  circular  shift  BCJR  decoding,  the  number  of  iterations  needed 
at  two  different  stop  conditions,  A  <  10*  and  A  <10*  are  compared.  Decoding  is  on 
the  same  HDCTCM  (4,3)  code  with  L=16.  Figures  6.7  and  6.8  show  the  number  of 
iterations  required  by  a  and  averaged  over  10,000  information  sequences.  They  show 
that  at  very  low  ,  under  stop  conditionA  <  10*  a  and  (3  need  about  twice  as 

many  iterations  as  under  stop  conditionA  <  10*^^*.  The  difference  becomes  smaller  as 
Ej^  /  Nq  increases.  Figure  6.9  is  the  bit  error  probability  of  decoding  this  code  under  these 
two  stop  conditions.  It  shows  that  a  and  obtained  at  A  <  10*^^*  lead  to  almost  the  same 
decode  decision  as  those  obtained  at  A  <  io*-'r  A  <10*  is  small  enough  to  control  the 
convergence. 
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-2  0  2  4  6  8 

Eb/N,{dB) 


Figure  6.7  Number  of  iterations  required  by  a  of  decoding  a  HDCTCM  (4,3)  with  L=16 
using  iterative  circular  shift  BCJR  for  two  stop  conditions  A  <  10^  and  A  <  10^ 


-2  0  2  4  6  8 

E,/N„(dB) 

Figure  6.8  Number  of  iterations  required  by  y^of  decoding  a  HDCTCM  (4,3)  with  L=16 
using  iterative  circular  shift  BCJR  for  two  stop  conditions  A  <  10^  and  A  <  10^ 
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Figure  6.9  Bit  error  probability  of  decoding  a  HDCTCM  (4,3)  with  L=16  using  iterative 
circular  shift  BCJR  for  two  stop  conditions  A  <  10^  and  A  <  10^ 


6,3,3  Comparison  with  Viterbi  Decoding 

Error  performance  of  iterative  circular  shift  BCJR  is  compared  with  Viterbi 
decoding.  Here  Viterbi  decoding  means  that  for  decoding  HDCTCM  («,£)),  run  Viterbi 
algorithm  a  total  number  of  S  times— one  time  for  each  possible  starting  state.  Figures 
6.10  and  6.11  show  the  error  performance  of  decoding  a  HDCTCM(4,2)  code  and  a 
HDCTCM  (4, 3)  code,  both  with  L=16  using  these  two  decoding  algorithms.  These 
figures  show  iterative  circular  shift  BCJR  decoding  achieves  at  least  as  good  a  bit  error 
probability  as  ML  decoding — Viterbi  decoding.  But  in  simulation,  the  execution  time  of 
iterative  circular  shift  BCJR  is  less  than  the  Viterbi  decoding  and  the  difference  gets 
bigger  when  the  trellis  becomes  larger.  This  can  be  explained  from  the  analysis  of  the 
computation  complexity  of  these  two  decoding  schemes  as  follows. 

For  decoding  HDCTCM  (n,D)  with  information  sequence  length  L,  in  iterative 
circular  shift  BCJR  decoding,  at  each  trellis  stage  t,  the  calculation  of  the  set  of  or 

requires  S  ■  n  multiplications  and  S  additions  of  n  numbers  each,  and  the  calculation  of 
<j,  requires  S  ■  n  multiplications  of  three  numbers  each.  The  computation  of  at  each 
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stage  is  quite  simple  and  implemented  as  table  lookup.  Therefore,  if  R  is  the  number  of 
iterations  needed,  then  roughly  the  total  eomputation  load  is 
R  ■  L  ■{3S  ■  n{<S))  +  S-{n- 1)(©))  .  ®  and  ©  denote  a  multiplieation  and  addition  operation 
on  two  numbers.  Due  to  the  good  eonvergenee  property  of  this  algorithm,  R  is  always  in 
the  range  of  integer  from  1  to  4.  In  Viterbi  deeoding— referring  to  Equation  (4.5),  at  eaeh 
stage  t— it  requires  a  ealeulation  quantity  essentially  similar  to  y,  and  the 


Figure  6.10  Error  performance  of  Viterbi  and  iterative  circular  shift  BCJR  decoding 
algorithms  on  a  HDCTCM  (4,2)  code  with  L=16 
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Figure  6.11  Error  performance  of  Viterbi  and  iterative  circular  shift  BCJR  decoding 
algorithms  on  a  HDCTCM  (4,3)  code  with  L=16 

add-compare-select  operation  on  all  the  states.  The  add-compare-select  operations  require 
S ■  n  additions  and  S  comparisons  of  S-n  numbers  each.  For  S  Viterbi  runs,  the 
computation  load  is  about  S-  L-{S-  n{®)  +  ^(comparision  on  (S •  n)  numbers)) .  We  can 
see  the  computation  load  is  linear  to  the  second  order  of  total  number  of  states  S, 
whereas  in  iterative  circular  shift  BCJR,  it  is  linear  to  the  first  order  of  S  with  a  small 
slope  R—a  small  fraction  of  S .  This  explains  the  difference  of  the  execution  times  and 
why  the  difference  becomes  bigger  for  larger  S . 

6,4  Bit  Error  Performance  of  HDCTCM 

In  this  section,  simulation  results  are  given  to  obtain  an  overall  bit  error 
performance  of  HDCTCM  (4,  Z)).  The  decoding  uses  iterative  circular  shift  BCJR 
algorithm. 

We  have  discussed  the  importance  of  the  minimum  distance  of  a  code  in 
determining  its  error  performance.  From  Figures  4.2  to  4.5,  we  see  the  minimum  distance 
of  HDCTCM  (4,  D)  is  increased  with  big  steps  when  the  information  length  L  is 
increased  starting  from  D  +  \,  and  then  will  reach  a  steady  value  at  some  point. 
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Accordingly,  the  bit  error  probability  will  deerease  with  big  steps  when  L  is  inereased 
starting  from  Z)  + 1  and  then  will  not  deerease  as  mueh  after  L  reaehes  some  value.  This 
trend  is  shown  in  Figures  6.12  and  6.13.  In  these  figures,  we  plot  the  bit  error  probability 
versus  the  information  length  for  deeoding  a  HDCTCM(4,2)  code  and  a  HDCTCM(4,3) 
eode. 


Figure  6.12  Bit  error  probability  of  a  HDCTCM  (4,2)  code  with  different  information 
sequence  length  L  decoded  using  iterative  circular  shift  BCJR 
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Figure  6.13  Bit  error  probability  of  a  HDCTCM  (4,3)  code  with  different  information 
sequence  length  L  decoded  using  iterative  circular  shift  BCJR 

For  any  HDCTCM (4, Z))  code  with  L  >2D  +  (0  ~2),  optimal  distance  codes  are 
built  in  Chapter  5.  Figure  6.14  shows  the  bit  error  probability  of  the  optimal  distance 
codes  for  HDCTCM(4,Z)),  0=2, 3, 4, 5.  Uncoded  4-PSK  is  regarded  as  a  reference 
system.  Its  bit  error  probability  is  also  plotted  here.  S  is  the  total  states  in  trellis.  DIS^:^^ 
is  the  minimum  distance  of  this  code.  It  can  be  seen  that,  at  bit  error  probability  10 
the  coding  gain  for  16,  64,  256,  and  1024  states  trellis  are  approximately  5.0  dB,  6.0  dB, 
6.6  dB,  and  7.2  dB,  respectively. 
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Bti  Error  Probabilrly 


Figure  6.14  Error  performance  of  optimal  distance  HDCTCM  (4,D)  codes  with  L=16  for 
D=2,3,4,5,  compared  with  uncoded  4-PSK  signaling 
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CHAPTER  7  CONCLUSIONS 


7.1  Summary 

Prior  to  this  dissertation,  a  circular  trellis  coding  with  permuted  state  structure 
was  invented  to  satisfy  the  state  constraint  without  code  rate  loss  or  initialization  of  the 
shift  register.  Trellis  coded  modulation  has  achieved  successful  applications  in  band- 
limited  channels. 

This  dissertation  develops  a  systematic  high  dimensional  circular  trellis-coded 
modulation  with  permuted  state  structure  (HDCTCM)  for  power-limited  spread  spectrum 
channels.  High  dimensional  simplex  signal  constellation  is  systematically  developed  to 
achieve  the  optimal  energy  efficiency  and  maximize  the  minimum  distance  among  error 
events  for  any  size  trellis.  This  is  done  by  analyzing  the  error  events  and  identifying  sets 
of  state  transitions  that  should  be  assigned  simplex  to  achieve  maximum  coding  gain. 
Butterfly  structure  of  trellis  coding  is  successfully  related  to  those  state  transitions  and 
perfectly  aligned  into  a  multidimensional  matrix— State  Transition  Matrix  (STM).  This 
matrix  is  designed  in  such  a  way  that  sets  of  state  transitions  that  should  be  assigned 
simplex  are  located  in  the  same  internal  location  of  the  butterflies  along  a  particular 
matrix  dimension.  An  algebraic  representation  of  a  simplex  in  a  high  dimensional  space 
is  built.  And  a  similar  multidimensional  matrix— Initial  Input  Simplex  (IIS)— having 
simplex  as  unit  element  is  built  in  such  a  way  that  the  signals  in  the  same  internal 
location  of  the  simplexes  along  a  particular  matrix  dimension  is  also  a  simplex.  A  one  to 
one  correspondence  is  built  between  the  states  in  STM  and  signals  in  IIS,  and  between 
the  state  transitions  in  STM  and  signals  in  the  signal  constellation.  The  construction  of 
STM,  IIS,  and  the  symbol  assignment  are  applicable  to  any  size  trellis. 

Minimum  distance  of  a  code  is  a  primary  parameter  in  determining  its  error 
correcting  capacity.  In  circular  trellis  coding,  the  starting  state  of  a  legal  path  can  be  any 
of  the  total  states  in  this  trellis;  conventional  algorithm  for  calculating  the  minimum 
distance  of  a  trellis  code  always  assumes  that  the  starting  state  is  0  state.  This  dissertation 
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develops  a  praetieal  eomputational  algorithm  to  ealeulate  minimum  distanee  of  eireular 
trellis  eoding.  The  minimum  distanee  of  HDCTCM  is  obtained  using  this  algorithm.  The 
eoding  gain  of  HDCTCM  is  evaluated  after  the  minimum  distanee  is  obtained. 

Due  to  the  systematie  eonstruetion  of  the  signal  eonstellation  and  symbol 
assignment,  upper  and  lower  bonds  on  the  minimum  distanee  of  HDCTCM  eodes  are 
derived.  Also,  this  dissertation  proves  that  these  bounds  ean  be  reaehed.  Furthermore,  a 
method  to  build  eodes  that  have  the  bounds  of  the  minimum  distanee  is  developed. 
Currently,  in  most  eoding  sehemes,  the  optimal  distanee  eodes  ean  only  be  obtained 
through  exhaustive  seareh. 

With  an  unknown  starting  state,  the  maximum  likelihood  deeoder  (Viterbi 
deeoder)  is  not  suitable  for  HDCTCM.  This  dissertation  explores  the  eireular  BCJR 
algorithm  for  deeoding  HDCTCM.  Iterative  eireular  shift  BCJR  is  developed.  In  this 
deeoding  seheme,  the  starting  state  is  statistieally  estimated  using  tentative  hard  deeision 
with  reliability  information,  and  the  eireular  eharaeter  of  HDCTCM  is  ineorporated  to 
make  the  most  reliable  symbol  in  the  reeeived  sequenee  as  the  starting  point  for 
deeoding.  Simulations  show  very  good  eonvergenee  property  of  iterative  eireular  shift 
BCJR  by  eomparison  with  other  eireular  BCJR  algorithms  and  for  different  stop 
eonditions.  Error  performanee  of  this  deeoding  algorithm  is  eompared  with  Viterbi 
deeoding.  Finally,  satisfaetory  bit  error  performanee  aehieved  by  HDCTCM  using 
iterative  eireular  shift  BCJR  deeoding  is  given  and  eompared  with  eorresponding 
uneoded  system. 

7.2  Further  Research 

Further  researeh  may  explore  the  eoneatenated  HDCTCM  eodes.  Two  types  of 
systems  are  possible: 

1.  Coneatenate  with  other  kind  of  error  eorreeting  eodes.  Using  HDCTCM  as  the  inner 
eode  and  other  error  eorreeting  eodes,  sueh  as  BCH  eodes  [30],  parity  eheek  eodes 
ete.  as  the  outer  eode. 

2.  Parallel  eoneatenation  of  two  or  more  HDCTCM  eodes  separated  by  an  interleaver. 
This  strueture  is  similar  to  turbo  eodes. 
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Concatenated  eodes  are  showed  to  have  inereased  error-eorreeting  eapaeity 
eompared  to  their  eonstituent  eodes.  The  deeoder  for  eoneatenated  eodes  should  eomprise 
deeoders  for  each  individual  constituent  eode.  Soft-output  information  (reliability  of  a 
hard  deeision)  other  than  hard  deeision  itself  should  be  generated  and  exehanged  between 
the  eonstituent  deeoders  [38]  [39]  [40]. 

Beeause  of  the  good  error  eorreeting  eapaeity  of  HDCTCM,  we  expeet  the 
eoneatenated  HDCTCM  to  have  better  performanee— possibly  as  good  as  turbo  eodes. 
Sinee  the  iterative  eireular  shift  BCJR  already  caleulates  the  soft-output  information  and 
has  iterative  nature,  it  is  very  possible  to  be  extended  for  deeoding  the  eoneatenated 
HDCTCM  eodes. 

Further  researeh  ean  also  explore  the  possibility  to  inerease  the  speed  of  iterative 
eireular  shift  BCJR  algorithm.  By  ineorporating  more  eharaeteristies  of  HDCTCM, 
knowledge  on  partial  path  ean  determine  the  whole  path,  and  it  is  possible  to  reduee  the 
eomputation  in  eurrent  algorithm  in  this  direetion. 
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Appendix  A  List  of  aii  paths  for  HDCTCM  (4,3)  with 
information  sequence  iength  L=D+1 
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APPENDIX  B  SYMBOL  ASSIGNMENT  CODE 


function  sym_tab=sym_asgn(n,D,DIM,start_st,pemiu,siv_free) 


%  Purpose:  This  function  is  the  main  function  to  assign  channel  symbols  to  state 
transitions  in  the  state  transtion  table. 

%Functions  to  generate  State  Transition  Matrix  (STM)— siv  gen.m  and  to  generate  the 
Initial  Input  Simplex(IIS)-inp_gen.m  are  called  by  this  function. 

%lnput  Parameters 

%n:  n-ary  information  symbol 

%D:  Trellis  Depth 

%DIM:  Dimensions  of  the  signal  constellation 

%Permu:  Record  the  order  of  assign  the  four  signals  in  the  related  source  simplex  to  start  st  to  the  four 
transitions  generating  from  start_st. 

%siv_free:  a  vector  containing  D+1  elements.  They  are  the  D+1  element  in  STM  FREE  to  build  STM. 
start  st  equavalent  to  STM_FREE(first  %location),  permu  is  equivalent  to  STM_FREE(right  side  butterfly), 
the  D+1  elements  in  siv  free  are  the  other  D+1  elements  in  STM  FREE. 


%ln  Function 

%TOT_ST:  Total  number  of  states  in  this  trellis. 

%ST_TAB:  State  transition  table  for  this  trellis,  a  TOT_ST  x  n  matrix.  ST_TAB(i,:)  are  the  next  states  of  the 
transitions  generating  from  state  i;  ST_TAB(i,j),i=1,2,...,TOT_ST,  j=1,2,...,n,  is  the  next  state  of  transition 
generating  from  state  i  when  the  input  is  j-1 . 

%INV_TAB:  Inverse  state  transition  table  for  this  trellis,  a  TOT_ST  x  n  matrix.  INV_TAB(i,j)  is  the  state  that 
can  transit  to  state  i  when  the  input  is  j-1 . 

%ALL_PATFIS:  All  the  legal  paths  in  this  trellis  when  information  sequence  length  is  equal  to  D+1. 
%SYMJNP:  Symbols  in  the  IIS. 

%ALL_SYMS:  All  the  symbols  in  the  signal  constellation. 

%SIV:  the  left  side  of  butterflies  in  STM 

%INDX_TAB:  A  TOT_ST  x  TOT_ST  matrix.  INDX_TAB(i,j),  i,j=1 ,2,...,TOT_ST  is  the  symbol  index  assigned 
to  the  transition  i->j.  When  i->j  is  not  allowed,  INDX_TAB(i,j)=0. 

%Output  Parameters 
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%sym_tab:  Channel  symbols  assigned  to  each  state  transition  in  ST_TAB.  It  is  a  TOT_ST  x  (3  x  n)  matrix. 
sym_tab(i,[(j-1)*3+1:j*3]),  j=1,2,...,n,  is  the  channel  symbol  assigned  to  state  transition  i->ST_TAB(i,j-1). 

%Date:  Mar  31,  April  6,  May  25,  1999 
%Author:  Xiangyu  Song 


global  TOT_ST  ALL_PATHS  ARY  SIV  RESHP_SYM_INP  SYM_INP  INV_STAB  INDX_TAB  ALL_SYMS 
L_USE; 

ARY=n; 

TOT_ST=n''D; 

ST_TAB=st_gen(n,D);%Generate  state  transition  table 
INV_STAB=inv_tab(n,D);%Generate  inverse  state  transition  table 
ALL_PATHS=all_paths(n,D);%  Generate  all  legal  path 

SYM_INP=inp_gen(n,D);%Generate  the  IIS 
if  D<=2 

RESHP_SYMJNP=SYMJNP; 

else 

RESHP_SYMJNP=[]; 

unit=n''2*(n*3); 

forj=0:TOT_ST/n''3-1 

sel_sym_inp=SYM_INP(j*unit+1  :(j+1  )*unit); 
sel_symjnp=reshape(sel_symjnp,n''2,n*3); 
for  i=0:n-1 

RESHP_SYMJNP=[RESHP_SYMJNP;sel_symJnp(:,i*3+1:(i+1)*3)]; 

end 

end 

end 

SIV=siv_gen(n,D,siv_free);%Generate  the  left  part  of  STM 

ALL_SYMS=get_all_syms; 

INDX_TAB=zeros(TOT_ST); 

L_USE=zeros(TOT_ST,n);%THis  is  a  loop  variable. L_USE(i,:)  is  to  recorde  that  among  the  four  symbols 
belonging  to  the  source  simplex  related  to  state  i  , which  one  has  been  used(1  if  already  been  used,  0 
otherwise).  The  purpose  is  to  reduce  the  searching  effort. 

%==============assign  the  first  simplex-transitioni============= 

stg=1; 

if  start_st==0  start_st=SIV(1  );end  %==start  from  siv(1  )=== 
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ini_fr=start_st; 

ini_to=ST_TAB(start_st,:)'; 

ft_trans=[ones(n,1)*ini_fr  ini_to(:)]; 

ft_siv_loc=find(SIV(:)==start_st); 

old_trans=ft_trans; 

old_siv_loc=ft_siv_loc; 

%=======define  permu============================ 

permutation=[1  2  3  4; 

1  324; 

34  12; 

2  3  14; 

3  124; 

1  24  3; 

432  1; 

4  12  3; 

342  1; 

24  3  1; 

324  1; 

3  14  2; 

2  34  1; 

32  14; 

2  14  3; 

1  4  3  2; 

1  34  2; 

4  13  2; 

1  42  3; 

4  3  12; 

24  13; 

42  13; 

2  134; 

42  3  1]; 

INDX_TAB(ini_fr,ini_to)=n*(start_st-1)+permutation(permu,:); 


%=====================assingn  simplex-transition2  till  simplex-transitionD- 

while  stg<D 
stg=stg+1; 

new_trans=get_new_trans(stg,old_trans); 

new_sivJoc=get_new_sivJoc(stg,old_sivJoc); 

mid_simp=get_mid_simp(new_sivJoc); 

assign(old_trans,new_trans,mid_simp); 
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old_trans=new_trans; 

old_siv_loc=new_siv_loc; 


end 


%=====================assign  simplex-transitiono+i  == 

if  D==1  new_trans=old_trans;  end 

final_simp=get_final_simp; 

final_assign(new_trans,final_simp); 

%==========reform  INDX_TAB  into  sym_tab========== 

sym_tab=[]; 

pos=(ST_TAB-1  )*TOT_ST; 
add=repmat([1  :TOT_ST]',  1  ,n); 
loc=pos+add; 
indx=INDX_TAB(loc(:)); 
sym=ALL_SYMS(indx(:),:); 
for  i=0:n-1 

sym_tab=[sym_tab  sym(i*TOT_ST+1:(i+1)*TOT_ST,:)]; 
end 


%=========end  of  function 

%======sUBFUNCTIONS= 


%========================================================= 

%obtain  simplex-transitioni+i's  (new  trans),  each  containing  a  simplex-transitioni  in  old_trans 
%========================================================== 

function  new_trans=get_new_trans(stg,old_trans) 
global  TOT_ST  ALL_PATHS  ARY  ; 
n=ARY; 
new_trans=[]; 
for  i=1  :size(old_trans,1 ) 
r=find(ALL_PATHS(:,stg)==old_trans(i,1)); 
rr=find(ALL_PATHS(r,stg+1)==old_trans(i,2)); 
int=floor((r(rr)-0.5)/n); 

temp=[ALL_PATHS([int*n+1  :(int+1  )*n],stg)  ALL_PATHS([int*n+1  :(int+1  )*n],stg+1 )]; 
new_trans=[new_trans;temp]; 
end 


%==============================: 

%obtain  the  locations  of  new_trans  in  SIV 
%==============================: 
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function  new_sivJoc=get_new_sivJoc(stg,old_sivJoc) 

global  ARY; 

n=ARY; 

aa=floor((old_sivjoc-0.5)/n''(stg-1)); 

bb=mod(aa,n); 

pos=bb(1); 

exp_old_sivJoc=repmat(old_sivJoc(:),1,n); 
%add=[0:n''(stg-1  ):(n-1  )*n''(stg-1 )]; 
add=[[-pos:0][1:n-1-pos]].*n''(stg-1); 
exp_add=repmat(add,size(old_sivJoc(:),1  ),1 ); 
new_sivJoc=exp_old_sivJoc+exp_add; 


%========================================================= 

%obtain  type  B  simplexes  by  mapping  the  locations  of  simplex-transtions  in  SIV  to  symobis  in  IIS 
%========================================================= 

function  mid_simp=get_mid_simp(sivJoc) 
global  ARY  TOT_ST  SYM_INP  SIV  RESHP_SYM_INP; 
n=ARY; 
mid_simp=[]; 
for  i=1:size(sivJoc,1) 
base=RESHP_SYMJNP(sivJoc(i, 
mid=simplex1  (base); 
mid_simp=[mid_simp;mid]; 
end 


%============================================= 

%assing  symbols  to  simplex-transtion2  till  simplex-transtionD 
%============================================= 

function  assign(old_trans,  new_trans,  simp); 
global  ARY  ALL_SYMS  INDX_TAB  L_USE; 
n=ARY; 

j_use=zeros(1  ,size(simp,1 )); 
for  i=1;size(old_trans,1) 
sel_new_trans=new_trans((i-1)*n+1;i*n,:); 
%r1=find(sel_new_trans(:,2)==old_trans(i,2)); 
r2=find(sel_new_trans(:,2)~=old_trans(i,2)); 
symJndx=INDX_TAB(old_trans(i,1),  old_trans(i,2)); 
sym_comp=ALL_SYMS(sym_indx,:); 
j_no_use=find(j_use==0); 
sel_simp=simp(j_no_use,:); 
j_flag=0; 
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for  j=1  :size(sel_simp,1 ) 


if  sel_simp(j,:)==sym_comp 
j_flag=1; 

loc=floor((j-0.5)/n)*n+1  :(floor((j-0.5)/n)+1  )*n; 
j_use(j_no_use(loc))=1 ; 
loc_simp=sel_simp(loc,:); 
m_use=zeros(1,n); 
m_use(j-floor((j-0.5)/n)*n)=1 ; 

for  k=1:size(r2,1) 
fr=sel_new_trans(r2(k),1 ); 
l_no_use=find(L_USE(fr,:)==0); 
for  1=1  :size(l_no_use,2) 
m_flag=0; 

m_no_use=find(m_use==0); 

left_simp=loc_simp(m_no_use,:); 

for  m=1:size(left_simp,1) 

if  ALL_SYMS((fr-1)*n+l_no_use(l),:)==left_simp(m,:) 

INDX_TAB(fr,sel_new_trans(r2(k),2))=(fr-1)*n+l_no_use(l); 

m_flag=1; 

m_use(m_no_use(m))=1 ; 

L_USE(fr,Lno_use(l))=1; 

end 

ifm_flag==1  break;end 
end  %==end  of  m======= 

ifm_flag==1  break;end 
end  %==end  of  1======= 

end  %==end  of  k======= 

end  %==end  of  if  simp(j,:)== 

ifj_flag==1  break;end 
end  %==end  of  j======== 

end  %==end  of  i=========== 


%======================================== 

%Generate  the  signal  constellation 
%======================================== 

function  all_syms=get_all_syms(); 

global  TOT_ST  SIV  RESHP_SYMJNP  ARY; 

n=ARY; 

%RESHP_SYMJNP=reshape(SYMJNP,TOT_ST,  3); 
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for  i=1:TOT_ST 

sr_simp=simplex2(RESHP_SYM_INP(i,:));%simplex2.m  generate  a  source  simplex  realted  to  the  input 
symbol 

all_syms((SIV(i)-1  )*n+1  :SIV(i)*n,:)=sr_simp; 
end 


%========================================================= 

%assign  symbols  to  simplex-transtionD+1 
%========================================================= 

function  final_assign(st_trans,final_simp) 

global  TOT_ST  ARY  INV_STAB  INDX_TAB  ALL_SYMS  L_USE; 

n=ARY; 

j_use=zeros(1  ,size(final_simp,  1 )); 
for  i=1:TOT_ST 

symJndx=INDX_TAB(st_trans(i,1),  st_trans(i,2)); 

sym_comp=ALL_SYMS(symJndx,:); 

r=find(INV_STAB(st_trans(i,2),:)~=st_trans(i,1)); 

j_no_use=find(j_use==0); 

sel_simp=final_simp(j_no_use,:); 

j_flag=0; 

for  j=1  :size(sel_simp,1 ) 

if  sym_comp==sel_simp(j,:) 
j_flag=1; 

loc=floor((j-0.5)/n)*n+1  :(floor((j-0.5)/n)+1  )*n; 
j_use(j_no_use(loc))=1 ; 
loc_simp=sel_simp(loc,:); 
m_use=zeros(1,n); 
m_use(j-floor((j-0.5)/n)*n)=1 ; 
for  k=1:size(r,2) 

fr=INV_STAB(st_trans(i,2),r(k)); 
l_no_use=find(L_USE(fr,:)==0); 
for  1=1  :size(l_no_use,2) 
m_flag=0; 

m_no_use=find(m_use==0); 
left_simp=loc_simp(m_no_use,:); 
for  m=1:size(left_simp,1) 

if  ALL_SYMS((fr-1)*n+Lno_use(l),:)==left_simp(m,:); 

INDX_TAB(fr,st_trans(i,2))=(fr-1)*n+Lno_use(l); 

m_flag=1; 

m_use(m_no_use(m))=1 ; 

L_USE(fr,Lno_use(l))=1; 
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end 

ifm_flag==1  break;end 
end  %==end  of  m 
ifm_flag==1  break;end 
end  %==end  of  I 
end  %==end  of  k 

end  %==end  of  if  sym_comp 

if  j_flag==1  break;  end 
end  %==end  of  j 

end  %==end  of  i 


%========================================================= 

%Obtain  all  the  type  B  simplexes  that  should  be  assinged  to  all  the  simplex-transitionD+i's 
%========================================================= 

function  final_simp=get_final_simp 

global  TOT_ST  RESHP_SYM_INP  ARY; 

n=ARY; 

final_simp=[]; 

for  i=1:TOT_ST/n 

temp=simplex1(RESHP_SYM_INP((i-1)*n+1;i*n,:));%simplex1.m  generate  four  type  B  simplexes 
formed  by  the  four  source  simpeixes  related  to  the  four  symbols  of  a  type  B  simplex 
final_simp=[final_simp;temp]; 
end 

%================================================== 
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APPENDIX  C  STATE  TRANSITION  MATRIX 
GENERATING  CODE 


function  siv=siv_gen(n,D,siv_free) 


%Purpose;  Generate  State  Transition  Matrix(STM).  This  funetion  only  generate  the  left 
side  (originating  states)  of  butterflies  in  STM,  the  right  side  of  butterflies  in  STM  is 
considered  when  doing  the  symbol  assignment— sym  asgn.m. 

%lnput  Parameters 

%n:  n-ary  information  symbol 

%D:  Trellis  Depth 

%siv_free:  a  vector  containing  D+1  elements.  They  are  STM_FREE(first  butterly,  left  side  butterfly,  1st 
dimension,  2nd  dimenstion,  (Z)  —  l),^dimenstion). 

%ln  Function 

%FLY:  All  butterflies  in  this  trellis.  FLY  is  a  FLY_NO*4  x  2  matrix. 

%L_FLY:  Left  side  of  all  the  butterflies. 

%R_FLY:  Right  side  of  all  the  butterflies. 

%MID_SIMP:  The  originating  state  sets  of  simplex-transtion3  to  simplex-transtionD+l.lt  is  a  n 
x(FLY_NO‘(D-2))  matrix.  Columns  MID_SIMP(:,(i-1)*FLY_NO+1:rFLY_NO),  i=1,2,...D-1,  are  the  originating 
state  sets  of  all  the  simplex-transitioni+2's.  The  originating  state  sets  of  simplex-transition2's  are  the  right 
sides  of  all  the  butterflies,  recorded  in  R_FLY. 

%L_USE,  R_USE,  MID_USE:  Loop  variables  used  to  record  which  L_FLY,  R_FLY,  MID_SIMP  has  been 
placed  into  SIV  already.  The  purpose  is  to  reduce  searching  efforts. 

%FREE:  The  particular  ways  to  place  the  butterflies  along  each  of  the  D-1  dimensions  of  SIV.  FREE(i,:), 
i=1,2,...,D-1,  defines  STM_FREE(t)^  dimension). 

%FREE_FT_L_FLY:  Defines  STM_FREE(left  side  butterfly). 

%free_ft_selj_fly: Defines  STM_FREE(first  butterfly). 

%Output  Parameters 

%siv:  a  D-1  dimensional  matrix,  unit  element  is  the  left  side  of  a  butterfly. 
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%Date:  May  13,24,1999 
%Author:  Xiangyu  Song 


global  L_USE  R_USE; 

global  MID_USE; 

global  FREE; 

global  FREE_FT_L_FLY; 

global  L_FLY  R_FLY; 

global  ARY; 

global  MID_SIM; 

global  FLY_NO;%=MID_NO 

ARY=n; 

%=====define  freedom  for  first  R-FLY  and  MID_SIMP: 
free_mat=[2  3  4; 

2  4  3; 

3  2  4; 

3  4  2; 

4  2  3; 

4  3  2]; 

free_ft_l_fly_mat=[1  2  3  4; 

1  24  3; 

1  324; 

1  34  2; 

1  42  3; 

1  4  3  2; 

2  134; 

2  14  3; 

2  3  14; 

2  34  1; 

24  13; 

24  3  1; 

3  124; 

3  14  2; 

32  14; 

324  1; 

34  12; 

342  1; 

4  12  3; 

4  13  2; 

42  13; 
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423  1; 

4  3  12; 

432  1;]; 

if  (isempty(siv_free)==1 ) 

FREE=repmat([2  3  4],D-1  ,1); 
free_ft_selj_fly=1 ; 

FREE_FT_L_FLY=free_ftJ_fly_mat(1,:); 

else 

FREE=free_mat(siv_free(3:size(siv_free,2)),:); 
free_ft_selj_fly=siv_free(1 ); 

FREE_FT_L_FLY=free_ft_Lfly_mat(siv_free(2),:); 

end 

TOT_ST=n''D; 

FLY_NO=TOT_ST/n;%Total  number  of  butterflies 
L_USE=zeros(1  ,FLY_NO); 

R_USE=zeros(1,FLY_NO); 

FLY=butterfly(n,D);%Generate  all  butterflies. 

FLY=reshape(FLY,n,FLY_NO*2);%First  FLY_NO  columns  are  the  left  side  of  all  butterflies,  second  FLY_NO 
columns  are  the  right  side  of  all  the  butterflies. 

L_FLY=FLY(:,1:FLY_NO); 

R_FLY=FLY(:,FLY_NO+1 :2*FLY_NO); 

MID_SIM=mid_simp(n,D);Generate  MID_SIM. 

MID_USE=zeros(D-2,FLY_NO); 


anchorJni=L_FLY(1,free_ft_selJ_fly);%==This  MayNOt  be  the  siv(1), since  the  First  L_FLY  has 
FREE_FT_L_FLY  can  put  it  to  any  place  among  siv(1:4). 

o/„=================D=i  4  STATES======================= 

if  D==1 

tab(FREE_FT_L_FLY)=L_FLY(:,free_ft_sel_Lfly); 

siv=tab';break; 

end 


%===============D=2  16  STATES: 

tab=build_ft_dim(anchorJni,0,[]); 
if  D==2  siv=tab;break;end 


anchor=tab(1); 
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%===============D=3  64  STATES=================== 

tot_ck_mat=build_tot_ck_mat(tab,2); 

tab(:,1)=tab; 

index=find(tot_ckmat(1,:)~=anchor); 

tab(1,FREE(2,:))=tot_ck_mat(1,index);%DIM  2  using  FREE(2,:) 
for  sd_dim=2:ARY 

tab(:,sd_dim)=build_ft_dim(tab(1,sd_dim),1,tot_ck_mat); 

end 

if  D==3  siv=tab;break;end 


%================D=4  256  STATES======================= 

tot_ck_mat=build_tot_ck_mat(tab,3); 

tab(:,:,1)=tab; 

index=find(tot_ck_mat(1 ,1  ,:)~=anchor); 

tab(1 ,1  ,FREE(3,:))=tot_ck_mat(1 ,1  .index);  %===FREE(3, :)===== 
for  td_dim=2:ARY 
forsd_dim=1:ARY 

ck_mat=tot_ck_mat(:  ,sd_d  i  m , : ) ; 
ck_mat=squeeze(ck_mat); 

tab(:,sd_dim,td_dim)=build_ft_dim(tab(1,sd_dim,td_dim),1,ck_mat); 
if  sd_dim==1 

ext_ck_mat=tot_ck_mat(1,[2:ARY],:); 

ext_ck_mat=squeeze(ext_ck_mat); 

tab(1,[2:ARY],td_dim)=extend(tab(1,1,td_dim),2,ext_ck_mat);%===[2  3  4]  is  not  flexible 
end 
end 
end 

if  D==4  siv=tab;break;end 

%================D=5  1024  STATES======================= 

tot_ck_mat=build_tot_ck_mat(tab,4); 

tab(:,:,:,1)=tab; 

index=find(tot_ck_mat(1 ,1 ,1  ,:)~=anchor); 

tab(1 ,1 ,1  ,FREE(4,:))=tot_ck_mat(1 ,1 ,1  ,index);%===FREE(4,:)======= 

for  four_dim=2:ARY 
fortd_dim=1:ARY 
forsd_dim=1:ARY 

ck_mat=tot_ck_mat(:,sd_dim,td_dim,:); 

ck_mat=squeeze(ck_mat); 

tab(:,sd_dim,td_dim,four_dim)=build_ft_dim(tab(1,sd_dim,td_dim,four_dim),1,ck_mat); 
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if  sd_dim==1 

ext_ck_mat=tot_ck_mat(  1 ,  [2:  ARY] ,  td_d  im , : ) ; 
ext_ck  mat=squeeze(ext_ck  mat);%  TO  (3,4) 

tab(1  ,[2:ARY],td_dim,four_dim)=extend(tab(1 ,1  ,td_dim,four_dim),2,ext_ck_mat);%===[2  3 

4]  is  not  flexible 
end 
end 

if  td_dim==1 

ext_ck_mat=tot_ck_mat(1 ,1  ,[2:ARY],:); 
ext_ck_mat=squeeze(ext_ck_mat); 

tab(1 , 1  ,[2:ARY],four_dim)=extend(tab(1 ,1,1  ,four_dim),3,ext_ck_mat); 
end 


end 

end 

if  D==5  siv=tab;break;end 


o/„================D=6  4096  STATES====================== 

tot_ck_mat=build_tot_ck_mat(tab,5); 

tab(:,:,:,:,1)=tab; 

index=find(tot_ck_mat(1 ,1 ,1 ,1  ,:)~=anchor); 

tab(1 ,1 ,1 ,1  ,FREE(5,:))=tot_ck_mat(1 ,1 ,1 ,1  ,index);%==FREE(5,:)====== 

for  five_dim=2:ARY 
for  four_dim=1  :ARY 
fortd_dim=1:ARY 
forsd_dim=1:ARY 

ck_mat=tot_ck_mat(: ,  sd_d  im ,  td_d  i  m  ,fou  r_d  im , : ) ; 
ck_mat=squeeze(ck_mat); 

tab(:,sd_dim,td_dim,four_dim,five_dim)=build_ft_dim(tab(1,sd_dim,td_dim,four_dim,five_dim),1,ck_mat) 
if  sd_dim==1 

ext_ck_mat=tot_ck_mat(1,[2:ARY],td_dim,four_dim,:); 

ext_ck_mat=squeeze(ext_ck_mat); 

tab(1,[2:ARY],td_dim,four_dim,five_dim)=extend(tab(1,1,td_dim,four_dim,five_dim),2,ext_ck_mat);%== 
=[2  3  4]  is  not  flexible 
end 
end 

if  td_dim==1 

ext_ck_mat=tot_ck_mat(1 ,1  ,[2:ARY],four_dim,:); 
ext_ck_mat=squeeze(ext_ck_mat); 
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tab(1 ,1  ,[2:ARY],four_dim,five_dim)=extend(tab(1 ,1,1  ,four_dim,five_dim),3,ext_ck_mat); 


end 

end 

if  four_dim==1 

ext_ck_mat=tot_ck_mat(1 ,1 ,1  ,[2:ARY],:); 
ext_ck_mat=squeeze(ext_ck_mat); 

tab(1 ,1 ,1  ,[2:ARY],five_dim)=extend(tab(1 ,1,1 ,1  ,five_dim),4,ext_ck_mat); 
end 
end 
end 

if  D==6  siv=tab;break;end 


0/„=================subFUNCTIONS================= 

%==================================:============== 

%Place  the  proper  left  side  of  butterfies  along  the  first  dimension 
%================================================ 

function  temp=build_ft_dim(start,ck_flag,ck_mat) 

%ck_mat  is  in  a  1 6X4  matrix 

global  ARY; 

global  L_USE  R_USE  ; 

global  FREE; 

global  L_FLY  R_FLY; 

global  FREE_FT_L_FLY; 

temp=zeros(ARY*ARY,1 ); 


o/„===================PUT  THE  FIRST  L_FLY== 

no_use=find(L_USE==0); 

no_useJ_fly=L_FLY(:,no_use); 

[row  col]=find(no_useJ_fly==start); 
se  IJ_f  ly = n  o_u  sejfl  y  ( : ,  co  I ) ; 

L_USE(no_use(col))=1; 

index=find(selj_fly~=start); 

if  ck_flag==0%===The  very  First  L_FLY  in  the  whole  siv  temp(FREE_FT_L_FLY)=selJ_fly; 
else 

temp(1  )=start; 

sel_ck_mat=ck_mat(2:ARY,:); 
for  i=1:size(index,1) 
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[row  col]=find(sel_ck_mat==selJ_fly(index(i))); 
temp(row+1  )=selj_fly(index(i)); 
end 
end 

o/„==================PUT  THE  FIRST  R_FLY======== 

no_use=find(R_USE==0); 

no_use_r_fly=R_FLY(:,no_use); 

[row  col]=find(no_use_r_fly==temp(1 )); 
se  l_r_fl  y = n  o_u  se_r_f  ly  ( : ,  CO  I ) ; 

R_USE(no_use(col))=1; 
index=find(sel_r_fly~=temp(1 )); 
if  ck_flag==0 

temp((FREE(1  ,:)-1  )*ARY+1  )=sel_r_fly(index);%===R_FLY  using  FREE(1 

else 

seLck_mat=ck_mat([1  :ARY-1]*ARY+1 
for  i=1:size(index,1) 

[row  col]=find(sel_ck_mat==sel_r_fly(index(i))); 
temp(row*ARY+1)=sel_r_fly(index(i)); 
end 
end 

o/o===================puT  THE  OTHER  THREE  L_FLY== 

if  ck_flag==0  %===USING  R_FLY  CHECK======== 

r_fly_ck=[]; 
for  i=2:ARY 

no_use=find(R_USE==0); 

no_use_r_fly=R_FLY(:,no_use); 

[row  col]=find(no_use_r_fly==temp(i)); 

R_USE(no_use(col))=1; 

'■_fly_ck=[r_fly_ck  no_use_r_fly(:  ,col)] ; 
end 

for  l_num=1:ARY-1 

no_use=find(L_USE==0); 

no_useJ_fly=L_FLY(:,no_use); 

[row  col]=find(no_useJ_fly==temp(l_num*ARY+1 )); 
se  IJ_f  ly = n  o_u  sejfl  y  ( : ,  co  I ) ; 

L_USE(no_use(col))=1; 
index=find(selJ_fly~=temp(l_num*ARY+1)); 
for  ele_no=1  :size(index,1 ) 

[row  col]=find(r_fly_ck==selJ_fly(index(ele_no))); 
temp(l_num*ARY+1+col)=selJ_fly(index(ele_no)); 
end 
end 
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else  %-========- 

fori  num=1:ARY-1 


USING  CK  MAT: 


no_use=find(L_USE==0); 

no_useJ_fly=L_FLY(:,no_use); 

[row  col]=find(no_useJ_fly==temp(l_num*ARY+1 )); 
se  l_l_f  ly = n  o_u  sejfl  y  ( : ,  co  I ) ; 

L_USE(no_use(col))=1; 
index=find(selJ_fly~=temp(l_num*ARY+1)); 
sel_ck_mat=ck_mat(l_n  u  m*  ARY+[2 :  ARY] , : ) ; 
for  ele_no=1  :size(index,1 ) 

[row  col]=find(sel_ck_mat==selJ_fly(index(ele_no))); 
temp(l_num*ARY+1+row)=selJ_fly(index(ele_no)); 
end 
end 

end  %===========END  of  IF  ELSE=================== 


%========================================================== 

%Place  the  first  three  originating  states  in  the  three  butterflies  along  dim  dimension  of  SIV 
%========================================================== 

function  temp=extend(from,  dim,ext_ck_mat)%ext_ck_mat  in  (3,4) 

global  ARY; 

global  MID_SIM; 

global  MID_USE; 

global  FLY_NO; 

seLmid_sim=MID_SIM(:,(dim-2)*FLY_NO+1  :(dim-1  )*FLY_NO); 
temp=zeros(1  ,ARY-1 ); 
no_use=find(MID_USE(dim-1,:)==0); 
no_use_mid=sel_mid_sim(:,no_use); 

[row  col]=find(no_use_mid==from); 
ext_mid=no_use_mid(:,col); 

MID_USE(dim-1  ,no_use(col))=1 ; 
index=find(no_use_mid(:,col)~=from); 
for  ele_no=1  :size(index,1 ) 

[row  col]=find(ext_ck_mat==ext_mid(index(ele_no))); 
temp(row)=ext_mid(index(ele_no)); 
end 


%: 
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%Find  all  the  simplex-transitions  containg  transitions  in  tab  asgned  along  the  dim  dimension  of  SIV. 
%========================================================== 

function  temp=build_tot_ck_mat(tab_asgned  ,  dim) 

global  MID_SIM; 

global  MID_USE; 

global  FLY_NO; 

global  ARY; 

seLmid_sim=MID_SIM(:,(dim-2)*FLY_NO+1  :(dim-1  )*FLY_NO); 
temp=[]; 

for  i=1:ARY''dim 

no_use=find(MID_USE(dim-1,:)==0); 

no_use_mid=sel_mid_sim(:,no_use); 

[row  col]=find(no_use_mid==tab_asgned(i)); 
temp=[temp  ;no_use_mid(:,col)']; 

MID_USE(dim-1  ,no_use(col))=1 ; 
end 

shape=[size(tab_asgned)  ARY]; 
temp=reshape(temp, shape); 
temp=squeeze(temp); 

%========================================================== 
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APPENDIX  D  INITIAL  INPUT  SIMPLEX  GENERATING 
CODE 


function  inp_sym=inp_gen(n,D); 


%Purpose:  This  function  generate  the  Initial  Input  Simplex(IIS). Using  6*2^(D-1) 
dimensions. 

%lnput  Parameters 

%n:  n-ary  information  symbol 

%D:  Trellis  Depth 

%ln  Function 

%pair:  “Copy”  rule  complied  by  a  type  B  simplex 

%fil_pat:  “fill”  pattern  (new  dimension  needed)  for  the  first  simplexes  built  along  the  first  dimension 
%fil:  “fill”  pattern  for  later  simplexes  built  along  the  first  dimension. 

%Output  Parameters 

inp  sym:  Regard  a  3-out-of-N  symbol  as  a  unit  element,  inp  sym  is  a  TOT_STX(4  symbis)  matrix. 

%When  D  increase  one,  just  create  a  new  dimension,  copy  the  previous  program  and  add  one  more  loop. 
%n=4. 


ini(:,1)=[1  -1  2  -2]'; 
ini(:,2)=[3  4  -3-4]'; 
ini(:,3)=[5  6  -6-5]'; 
dim=6; 
tab=ini; 

pair(:,1)=[1  2  3  4]'; 
pair(:,2)=[1  3  2  4]'; 
pair(:,3)=[1  4  2  3]'; 

o/„=======D=l  4  STATES==== 

if  D==1  inp_sym=tab;break;end 
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%^=^=^==Q=2  16  STATES: 
%=======fill  patern====== 


fiLpat(:,1)=[1  1  2  2]'; 
fil_pat(:,2)=[1  2  1  2]'; 
fiLpat(:,3)=[1  2  2  1]'; 

%======match  to  pair(2,i)================== 

for  i=1:3 

tab((pair(2,i)-1  )*n+1  :pair(2,i)*n,i)=(-1  ).‘ini(:,i); 

end; 

%==========fill  pair(3,i)  and  match  to  pair(4,i)======= 

for  i=1:3 

tab((pair(3,i)-1)*n+1:pair(3,i)*n,i)=(fil_pat(:,i)+dim).*sign(ini(:,i)); 

tab((pair(4,i)-1  )*n+1  :pair(4,i)*n,i)=(-1  ).*tab((pair(3,i)-1  )*n+1  :pair(3,i)*n,i); 

dim=dim+2; 

end; 

if  D==2  inp_sym=tab;break;end 

%====later  fill  one  clolum  by  one  colum======================== 

fil_sign=sign(tab); 

fil(:,1)=[1  1  22  1  1  223  344  3344]'; 
fil(:,2)=[1  21234341212343  4]'; 
fil(:,3)=[1  22134433443122  1]'; 
step=3; 


%===========D=3  64  state: 

%======match  to  pair(2,i)== 


for  i=1:3 

tab(:,(pair(2,i)-1  )*step+i)=(-1  ).*tab(:,i); 
end; 

%==========fill  pair(3,i)  and  match  to  pair(4,i)==== 

for  i=1:3 

tab(:,(pair(3,i)-1)*step+i)=(fil(:,i)+dim).*fil_sign(:,i); 

tab(:,(pair(4,i)-1)*step+i)=(-1).*tab(:,(pair(3,i)-1)*step+i); 

dim=dim+4; 

end; 

if  D==3  inp_sym=tab;break;end 
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%======^D=4  256  STATES============================= 

%==========match  to  pair(2,i)==================== 

for  i=1:3 

tab(:,[0:step:(n-1  )*step]+i,pair(2,i))=(-1  ).*tab(:,[0:step:(n-1  )*step]+i); 
end 


%=======fill  pair(3,i)  and  match  to  pair(4,i)============ 

for  i=1:3  %  3  col 

%===COMPLETELY  FILL  A  TWO-DIM  PLANE  OF  COL  I  THIRD  DIM=pair(3,i) 
forj=1:2:3 

tab(:,(pair(j,i)-1)*step+i,pair(3,i))=(fil(:,i)+dim).*fil_sign(:,i); 
tab(:,(pair(j+1  ,i)-1  )*step+i,pair(3,i))=(-1  ).*tab(:,(pair(j,i)-1  )*step+i,pair(3,i)); 
dim=dim+4; 
end  ; 

%======match  to  third  dim=pair(4, !)============= 

tab(:,[0:step:(n-1  )*step]+i,pair(4,i))=(-1  ).*tab(:,[0:step:(n-1  )*step]+i,pair(3,i)); 
end 

if  D==4  inp_sym=tab;break;end 


o/„================D^5  1 024======================== 

%============maTCH  to  a  new  DIM(F0URTH)=PAIR(2,I) 


tab(:,:,:,1)=tab; 
for  1=1:3 

tab(:,[0:step:(n-1)*step]+i,:,pair(2,i))=(-1).*tab(:,[0:step:(n-1)*step]+i,:,1); 

end 

%========fill  and  match============= 

for  1=1:3  %COL  OF  I  IN  3-OUT-OF-DIM======== 

%==COMPLETE  FILL  THE  ITH  COL  IN  FOURTH  DIM=PAIR(3,I),IT  IS  A  THREE-DIM  CUBE, ALL 
OPERATION  DONE  IN  THE  SAME  FOURTH  DIM=PAIR(3,I)========= 

fortd  dim=1:2:3 


%==COMPLETE  FILL  THE  ITH  COL  IN  THIRD  DIM=PAIR(TD_DIM,I),IT  IS  A  TWO-DIM  PLANE  OF  THE 
FORMAT  OF  THE  INPUT  FOR  64  STATES========================== 

forsd_dim=1:2:3 

tab(:,(pair(sd_dim,i)-1)*step+i,pair(td_dim,i),pair(3,i))=(fil(:,i)+dim).*fil_sign(:,i); 
tab(:,(pair(sd_dim+1  ,i)-1)*step+i,pair(td_dim,i),pair(3,i))=(-1).*tab(:,(pair(sd_dim,i)- 
1)*step+i,pair(td_dim,i),pair(3,i)); 
dim=dim+4; 

end 
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%==MATCH  IN  THE  THIRD  DIM=============== 

tab(:,[0:step:(n-1  )*step]+i,pair(td_dim+1  ,i),pair(3,i))=(-1  ).*tab(:,[0:step:(n- 
1)*step]+i,pair(td_dim,i),pair(3,i)); 
end 

%===match  to  fouth  dim=pair(3, !)================= 

tab(:,[0:step:(n-1  )*step]+i,:,pair(4,i))=(-1  ).*tab(:,[0:step:(n-1  )*step]+i,:,pair(3,i)); 
end 

if  D==5  inp_sym=tab;break;end 


%============D=6  4096  STATES========= 

o/o===========MATCH  to  a  new  DIM(FIFTH): 


tab(:,:,:,:,1)=tab; 
for  1=1:3 

tab(:,[0:step:(n-1  )*step]+i,:,:,pair(2,i))=(-1  ).*tab(:,[0:step:(n-1  )*step]+i,:,:,1 ); 
end 

%===FILL  &  MATCH  IN  FIFTH  DIM=PAIR(3,I)== 
for  1=1:3 

forfour_dim=1:2:3 

fortd_dim=1:2:3 

forsd_dim=1:2:3 

tab(:,(pair(sd_dim,i)- 

1)*step+i,pair(td_dim,i),pair(four_dim,i),pair(3,i))=(fil(:,i)+dim).*fil_sign(:,i); 

tab(:,(pair(sd_dim+1,i)-1)*step+i,pair(td_dim,i),pair(four_dim,i),pair(3,i))=(- 

1).*tab(:,(pair(sd_dim,i)-1)*step+i,pair(td_dim,i),pair(four_dim,i),pair(3,i)); 

dim=dim+4; 

end 

tab(:,[0:step:(n-1)*step]+i,pair(td_dim+1,i),pair(four_dim,i),pair(3,i))=(-1).*tab(:,[0:step:(n- 

1)*step]+i,pair(td_dim,i),pair(four_dim,i),pair(3,i)); 

end 

tab(:,[0:step:(n-1  )*step]+i,:,pair(four_dim+1  ,i),pair(3,i))=(-1  ).*tab(:,[0:step:(n- 
1)*step]+i,:,pair(four_dim,i),pair(3,i)); 
end 

%===MATCH  TO  FIFTH  DIM=PAIR(4,I)======== 

tab(:,[0:step:(n-1)*step]+i,:,:,pair(4,i))=(-1).*tab(:,[0:step:(n-1)*step]+i,:,:,pair(3,i)); 

end 

if  D==6  inp_sym=tab;break;end 
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APPENDIX  E  MINIMUM  DISTANCE  CALCULATION 
CODE  (1) 


function  [min_dis,  min_path]=min_dis_samest(n,D,DIM,B,start_st) 


%Purpose:  This  function  seek  the  minimum  distance  among  paths  with  the  same  start  st. 

%lnput  Parameters 

%n:  n-ary  information  symbol 

%D:  Trellis  Depth 

%DIM:  Dimensions  of  the  signal  constellation 

%start_st:  Starting  states  for  all  the  paths 

%B:  Information  sequence  length 

%stab:  State  transition  table  for  this  trellis 

%sym_tab:  symbol  assignment  table,  generated  by  sym_asgn.m 

%ln  Function 

%TOT_ST:  Total  number  of  states  in  this  trellis. 

%full_txs:  Turn  sym_tab  in  TOT_ST  x  (n*3)  matrix  into  (S‘n)  x  DIM  matrix. The  TOT_ST  rows-full_txs((i- 
1)*TOT_ST+1:i*TOT_ST,  :)  are  the  symbols  assinged  to  the  TOT_ST  transissons  when  input  is  i-1. 
i=1,2,...,n.  Symbols  are  represented  as  0  or  (+)(-)1  in  all  the  DIM  dimensions. 

%dis_old(new):  TOT_ST  x  TOT_ST  matrix.  dis_old(new)(i,j)  is  the  minimum  distance  among  all  the  paths 
reaching  state  i  and  j  at  previous(current)  stage.  i,j=1,2,...TOT_ST. 

%path_old(new):TOT_ST  x  TOT_ST  x  (2*B)  matrix.  path_old(new)(i,j)  is  the  path  history  of  the  pair  of  paths 
reaching  state  i  and  j  and  having  dis_old(new)(i,j). 

%Output  Parameters 

%min_dis:  The  minimum  distance  among  paths  with  the  same  start  st. 

%min_path:  Paths  history  of  the  pair  of  paths  having  distance  min_dis  between  them. 

%Date:  May  16,  1999  Xiangyu  Song 


global  TOT_ST  ARY  fulljxs  INV_ST_TAB  TXS; 
ARY=n; 

TOT_ST=n''D; 
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ST_TAB=stab; 

TXS=sym_tab; 

INV_STAB=inv_tab(n,D);%Generate  inverse  state  transition  table 
full_txs=fu_sym(n,D,DIM);%Generate  full_txs 

%==============lnitialization======================================= 

dis_old=ones(TOT_ST)*inf; 

dis_old(start_st,start_st)=0; 

path_old=(-1  )*ones(TOT_ST,  TOT_ST,  2*(B+1)); 
path_new=path_old ; 

reach=start_st; 

inv_reach=zeros(D-1  ,n''(D-1 )); 
fr_reach=zeros(D-1,  n''(D-1)); 

temp=start_st; 
for  i=1:D-1 

temp=INV_ST_TAB(temp(:),:); 

temp=temp(:)'; 

inv_reach(i,[1:size(temp,2)])=temp; 

end 

temp=start_st; 
for  i=1:D-1 

temp=ST_TAB(temp(:),  :); 
temp=temp(:)'; 

fr_reach(i,[1:size(temp,2)])=temp; 

end 

%====get  the  common  part  for  updating  all  state  pair  with  p~q;========== 

st_p_all=[1  :TOT_ST];st_q_all=[1  :TOT_ST]; 

[pair_p_all_dif,pair_q_all_dif,reach_p_all_dif,reach_q_all_dif]=pair_st_dif(st_p_all,st_q_all); 

add_dis_all_dif=get_add_dis(reach_p_all_dif,reach_q_all_dif,16); 

[pair_p_all_same,pair_q_all_same,reach_p_all_same,reach_q_all_same]=pair_st_same(st_p_all,st_q_all); 

add_dis_all_same=get_add_dis(reach_p_all_same,reach_q_all_same,16); 

end 


%==========travel  along  the  trellis======: 

forstg=1:B-D 

%deal  with  pair-p-q  with  p~=q;=========== 

if  stg>=B-D+1 

st_p=inv_reach(B-stg,[1:n''(B-stg)]); 
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st_q =i  n  v_reach  ( B-stg ,  [1 :  n''(  B-stg )] ) ; 

[pair_p,pair_q,reach_p,reach_q]=pair_st_dif(st_p,st_q); 

add_dis=get_add_dis(reach_p,reach_q,16); 

elseif  stg<D  %consider  reach  states,  others  are  |NF======== 

reach=ST_TAB(reach,:); 

st_p=reach(:)';st_q=reach(:)'; 

%==not_reach  states  INF  ,  used  by  later  stage===== 

alLst=[1  :TOT_ST]; 

all_st(reach)=0; 

[not_reach_pos]=find(all_st~=0); 

dis_new(not_reach_pos,not_reach_pos)=inf;%======== 

dis_new(reach,not_reach_pos)=inf; 
dis_new(not_reach_pos, reach  )=inf; 

%====state  pair  with  p~=q 

[pair_p,pair_q,reach_p,reach_q]=pair_st_dif(st_p,st_q); 

add_dis=get_add_dis(reach_p,reach_q,16); 

else  %consider  all  states================ 

st_p=[1  :TOT_ST];st_q=[1  :TOT_ST]; 
add_dis=add_dis_all_dif; 
pa  i  r_p = pa  i  r_p_a  I  l_d  if ;  pa  i  r_q = pa  i  r_q_a  I  l_d  if ; 
reach_p=reach_p_all_dif;reach_q=reach_q_all_dif; 
end 

dis_mat=dis_old(reach_p+(reach_q-1)*TOT_ST)'+add_dis; 

dis_mat=reshape(dis_mat,n*n,size(reach_p,2)/(n*n)); 

[min  pair  dis,  min_pos]=min(dis_mat,[],1 ); 
dis_new(pair_p+(pair_q-1)*TOT_ST)=min_pair_dis; 

dis_new(pair_q+(pair_p-1)*TOT_ST)=dis_new(pair_p+(pair_q-1)‘TOT_ST);%symmetry 
%========Update  symbols  in  the  paths  reaching  state  p  and  q 

path_update1(stg,pair_p,  pair_q,  reach  p,  reach  q,  min_pos,16); 

%deal  with  pair-p-q  with  p=q;============= 

if  stg<B-D 

dis_new(st_p+(st_q-1)*TOT_ST)=0; 

%=======Update  paths  reaching  state  p  and  q 

path_update2(stg,st_p,  st_q,fr_reach,  start  st); 

else  %B-D,  min(12) 
if  stg>=B-D+1 

[pair_p,pair_q,reach_p,reach_q]=pair_st_same(st_p,st_q); 
elseif  stg<D 
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[pair_p,pair_q,reach_p,reach_q]=pair_st_same(st_p,st_q); 
%add_dis=add_dis(reach_p,reach_q,  1 2); 
else  %all  state  pair  with  p==q 

pair_p=pair_p_all_same;pair_q=pair_q_all_same; 

reach_p=reach_p_all_same;reach_q=reach_q_all_same; 


end 

[non_same_pos]=find((reach_p-reach_q)~=0); 

reach_p=reach_p(non_same_pos); 

reach_q=reach_q(non_same_pos); 

add_dis=get_add_dis(reach_p,reach_q,12);  %12=== 

dis_mat=dis_old(reach_p+(reach_q-1)*TOT_ST)'+add_dis; 

dis_mat=reshape(dis_mat,n*(n-1),size(reach_p,2)/(n*(n-1)));%12= 

[min_pair_dis,min_pos]=min(dis_mat,[],1); 

dis_new(pair_p+(pair_q-1)*T0T_ST)=min_pair_dis; 

dis_new(pair_q+(pair_p-1)‘T0T_ST)=dis_new(pair_p+(pair_q-1)*T0T_ST);%symmetry 
%========Update  symbols  in  the  paths  reaching  state  p  and  q 

path_update1(stg,pair_p,  pair  q,  reach  p,  reach  q,  min_pos,12); 


end 

dis_old=dis_new; 

path_old=path_new; 

end; 

forstg=B-D+1:B 
if  stg<B 

st_p=inv_reach(B-stg,[1:n''(B-stg)]); 

st_q=inv_reach(B-stg,[1:n''(B-stg)]); 

else 

st_p=start_st; 

st_q=start_st; 

end 

o/„====p~=q================== 

if  stg~=B  %===stg==B,only  p==q===== 

[pair_p,pair_q,reach_p,reach_q]=pair_st_dif(st_p,st_q); 

add_dis=get_add_dis(reach_p,reach_q,16); 

dis_mat=dis_old(reach_p+(reach_q-1)*TOT_ST)'+add_dis; 

dis_mat=reshape(dis_mat,n*n,size(reach_p,2)/(n*n));%===16 

[min_pair_dis,min_pos]=min(dis_mat,[],1); 

dis_new(pair_p+(pair_q-1)*TOT_ST)=min_pair_dis; 

dis_new(pair_q+(pair_p-1)*TOT_ST)=dis_new(pair_p+(pair_q-1)*TOT_ST);%symetrity 
path_update1(stg,pair_p,  pair  q,  reach  p,  reach  q,  min_pos,16); 
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end 

o/„=====p==q================== 

[pair_p,pair_q,reach_p,reach_q]=pair_st_same(st_p,st_q); 

add_dis=get_add_dis(reach_p,reach_q,16); 

dis_mat=dis_old(reach_p+(reach_q-1)*TOT_ST)'+add_dis; 

dis_mat=reshape(dis_mat,n*n,size(reach_p,2)/(n*n));%===16 

[min_pair_dis,min_pos]=min(dis_mat,[],1); 

dis_new(pair_p+(pair_q-1)*T0T_ST)=min_pair_dis; 

dis_new(pair_q+(pair_p-1)*T0T_ST)=dis_new(pair_p+(pair_q-1)*T0T_ST);%symetrity 
path_update1(stg,pair_p,  pair  q,  reach  p,  reach  q,  min_pos,16); 
dis_old=dis_new; 
path_old=path_new; 
end 

m  in_d  is=d  is_old  (start_st,  start_st) ; 
sel_path=squeeze(path_old(start_st,  start  st,:))'; 
min_path=[seLpath(1 :2:2*B-1  );sel_path(2:2:2*B)]; 


o/„==:.====SUBFUNCTIONS================================== 

%====================================================== 

%Update  path  history 

%====================================================== 

function  path_update1(stg,pair_p,  pair  q,  reach  p,  reach  q,  min_pos,item_no) 

global  ARY  ST_TAB  path_old  path  new; 

n=ARY; 

for  i=1:size(pair_p,2) 

pre_p=reach_p(item_no*(i-1)+min_pos(i)); 

pre_q=reach_q(item_no*(i-1)+min_pos(i)); 

pos_p=find(ST_TAB(pre_p,:)==pair_p(i)); 

sym_p=pos_p-1; 

pos_q=find(ST_TAB(pre_q,:)==pair_q(i)); 

sym_q=pos_q-1; 

if  stg==1 

a=[  sym_p  sym_q]; 

else 

a=[squeeze(path_old(pre_p,  pre_q,[1:(stg-1)*2]))' sym_p  sym_q]; 
end 

path_new(pair_p(i),  pair_q(i),  [1 :2*stg])=a; 

end; 
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%====================================================: 

%Update  path  history  for  stg<B-D  and  p==q 
%====================================================: 

function  path_update2(stg,st_p,  st_q,fr_reach,  start  st) 

global  ARY  TOT_ST  Depth  INV_ST_TAB  ST_TAB  path_old  path_new; 

n=ARY; 

D=Depth; 


if  stg==1 

pre_p=start_st; 
elseif  stg>D 

pre_p=[1  :TOT_ST]; 

else 

pre_p=fr_reach(stg-1 ,  [1  :n''(stg-1 )]); 
end 

for  i=1:size(st_p,2) 

from=intersect(pre_p,INV_ST_TAB(st_p(i),:)); 
pos=find(ST_TAB(from(1),:)==st_p(i)); 
sym_p=pos-1; 
if  stg==1 

a=[sym_p  sym_p]; 

else 

a=[squeeze_old(path(from(1  ),from(1  ),[1 :2*(stg-1 )]))'  sym_p  sym_p]; 
end 

path_new(st_p(i),st_q(i),[1:2*stg])=a; 

end 


%====================================================== 

%Obtain  the  path  metric  of  from  previous  stage  to  current  stage, for  the  paths  reaching  state  pair(p,q) 
%=======================:=============================== 

function  add_dis=get_add_dis(reach_p,reach_q,itm_no) 

global  TOT_ST  ARY  fulljxs; 

n=ARY; 


add_dis=[]; 

adder=[0:TOT_ST:TOT_ST*(n-1 )]; 
adder_p=repmat(adder,itm_no/n,1); 
adder_p=repmat(adder_p(:)',1,size(reach_p,2)/(itm_no)); 
pos_p=adder_p+reach_p; 

adder_q=repmat(adder,1  ,n); 
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if  itm_no==12 

lost_pos=[1  :n]+[0:n:(n-1  )*n]; 
adder_q(lost_pos)=-1 ; 
keep_pos=find(adder_q~=-1 ); 
adder_q=adder_q(keep_pos); 
end 

adder_q=repmat(adder_q,1,size(reach_q,2)/(itm_no)); 

pos_q=adder_q+reach_q; 

%====  This  is  deal  with  "out  of  Memory "  when  256  states==== 

size_64=64*63/2*itm_no; 

no_64=floor(size(pos_p,2)/size_64); 

forcount=1:no_64 

reach_p_sym=full_txs(pos_p((count-1)*size_64+1:count*size_64),:); 

reach_q_sym=full_txs(pos_q((count-1)*size_64+1:count*size_64),:); 

add_dis_part=sum((reach_p_sym-reach_q_sym).''2,2); 

add_dis=[add_dis;  add  dis  part]; 

end; 

reach_p_sym=full_txs(pos_p(no_64*size_64+1:size(pos_p,2)),:); 
reach_q_sym=full_txs(pos_q(no_64*size_64+1:size(pos_q,2)),:); 
add_dis_part=sum((reach_p_sym-reach_q_sym).''2,2); 
add_dis=[add_dis;  add  dis  part]; 


%======================================================= 

%Generate  state  pair(p,q)  and  their  precessors  with  p~=q,  p  blongs  to  st_p,  q  belongs  to  st_q 
%======================================================= 

function  [pair  p,  pair  q  ,reach_p,  reach_q]=pair_st_dif(st_p,st_q) 
global  ARY  INV_ST_TAB; 
n=ARY; 


pair_p=[];pair_q=[];reach_p=[];reach_q=[]; 
for  i=1:size(st_p,2)-1 

pair_p=[pair_p  st_p(i)*ones(1  ,size(st_q,2)-i)]; 
pair_q=[pair_q  st_q((i+1  ):size(st_q,2))]; 
end 

reach_p=INV_ST_TAB(pair_p,:); 

reach_p=reach_p'; 

reach_p=repmat(reach_p(:),1,n);%n=4 

reach_p=reach_p'; 
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reach_p=reach_p(:)';%row  vector 
reach_q=INV_ST_TAB(pair_q,:); 
reach_q=repmat(reach_q,1  ,n); 
reach_q=reach_q'; 

reach_q=reach_q(:)';%row  vector,  16*size(pair_q, 2) 


%======================================================= 

“/oGenerate  state  pair(p,q)  and  their  precessors  with  p==q,  p  blongs  to  st_p,  q  belongs  to  st_q 
%======================================================= 

function  [pair  p,  pair_q  ,reach_p,  reach_q]=pair_st_same(st_p,st_q) 
global  ARY  INV_ST_TAB; 
n=ARY; 

pair_p=st_p;pair_q=st_q;reach_p=[];reach_q=[]; 

reach_p=INV_ST_TAB(pair_p,:); 

reach_p=reach_p'; 

reach_p=repmat(reach_p(:),1,n);%n=4 
reach_p=reach_p'; 
reach_p=reach_p(:)';%row  vector 
reach_q=INV_ST_TAB(pair_q,:); 
reach_q=repmat(reach_q,1  ,n); 
reach_q=reach_q'; 

reach_q=reach_q(:)';%row  vector,  16*size(pair_q, 2) 
%========================================================= 
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APPENDIX  F  MINIMUM  DISTANCE  CALCULATION  CODE 

(2) 


function  [min_dis,  ml_sym]=vit(n,D, DIM, B_Size,ref_path, stab, sym_tab); 


%Purpose:  This  function  seek  tbe  minimum  distance  from  a  reference  path  to  all  tbe 
paths  that  have  different  starting  states  as  the  starting  state  of  the  reference  path.The 
method  is  to  run  viterbi  algorithm  on  the  trellis  having  different  starting  states  as  the 
starting  state  of  the  reference  path. 

%n:  n-ary  information  symbol 
%D:  Trellis  Depth 

%DIM:  Dimensions  of  the  signal  constellation 

%ref_path:  The  reference  path 

%B_Size:  Information  sequence  length 

%stab:  State  transition  table  for  this  trellis 

%sym_tab:  Symbol  assignment  table,  generated  by  sym_asgn.m 

%ln  Function 

%TOT_ST:  Total  number  of  states  in  this  trellis. 

%st_metric:  A  vector  containing  TOT_ST  element,  st_metric(i)  is  the  path  metric  of  state  i.  At  a  certain 
stage,  it  is  the  minmum  distance  between  the  paths  reaching  state  i  and  the  reference  path. 

%st_sym:  Path  history.  A  B_SizeXTOT_ST  matrix.  st_sym(:,i),  i=1,2,...,TOT_ST,is  the  input  symbles  on  the 
path  reaching  state  i  and  having  distance  st_metric(i)  from  the  reference  path. 

%Output  Parameters 

%min_dis:  The  minimum  distance  from  a  reference  path  to  all  the  paths  that  have  different  starting  states  as 
the  starting  state  of  the  reference  path. 

%ml_sym:  The  path  having  distance  min_dis  from  the  reference  path. 

%Date:  April  14,1999  Xiangyu  Song 


global  TOT_ST  ST_TAB  TXS  ; 
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TOT_ST=n''D; 

TOT_ST=n''D; 

ST_TAB=stab; 

TXS=sym_tab; 

INV_STAB=inv_tab(n,D);%Generate  inverse  state  transition  table 


TRS_INV_ST_TAB=INV_ST_TAB'; 
full_txs=fu_sym(n,D,DIM);%Generate  full_txs 


st_metric=zeros(TOT_ST,1 ); 
adder=[0:TOT_ST:(n-1  )*TOT_ST]'; 
adder=repmat(adder,1  ,TOT_ST); 
pos_merge_st=TRS_INV_ST_TAB+adder; 

B=B_Size; 

full_sym=repmat(full_txs,[1  1  B]); 

[in_sym,  ref  out,  st_seq]=enco_fr_deco(ref_path,n,D,DIM,B,1);%Get  the  state  transition  sequence  and 
channel  symbol  sequence  for  ref_path 
ref_st=st_seq(1 ); 
ref  o  u  t=f  u  1 1  (ref  o  u  t ) ; 

rev_mat=repmat(ref_out,[T  OT_ST*n  1  ] ); 
rev_mat=reshape(rev_mat,n*TOT_ST,DIM,B); 

dif=((full_sym-rev_mat).''2); 

dif=-sum(dif,2); 

dif=squeeze(dif); 

sel_metric=[];sel_sym=[]; 

for  STAR_ST=[[1:ref_st-1][ref_st+1:TOT_ST]]  %===run  for  each  state 

%========Get  path  metrics  and  survivors  for  states  at  each  stage======= 

st_sym=[]; 

METRIC_MAT=reshape(dif,TOT_ST,n,B); 

%==travel  trellis  for  stg_no=2: □===== 
metric=METRIC_MAT(STAR_ST,:,1 ); 
reach=ST_TAB(STAR_ST,:); 
sym=[0:n-1]; 

for  stg_no=2:D 

add_metric=METRIC_MAT(reach(:),:,stg_no); 
exp_metric=repmat(metric(:),1 , 4); 
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metric=expjnetric+add_metric; 

reach=ST_TAB(reach(:),:); 

add_sym=repmat([0:n-1],n''(stg_no-1),1); 
exp_sym=repmat(sym,1  ,n); 
sym=[exp_sym;  add_sym(:)']; 
end  %end  ofstg_no=2:D 

st_metric(reach(:))=metric; 

st_sym(:,reach(:))=sym; 


%========travel  trellis  for  stage_no=D+1  :B=== 

for  stage_no=D+1  :B 

add_metric=dif(pos_merge_st(:),stage_no); 
merg_metric=st_metric(TRS_INV_ST_TAB(:))+add_metric; 
merg_metric=reshape(merg_metric,n,TOT_ST); 
[max_merg_metric  max_pos]=max(merg_metric,[],1 ); 
st_metric=max_merg_metric'; 

fr_st_pos=max_pos+n*[0:TOT_ST-1]; 
fr_st=TRS_l  NV_ST_TAB(fr_st_pos(: )); 
st_sym=[st_sym(:,fr_st(:));  max_pos-1];%update 


end; 

sel_metric=[sel_metric  st_metric(STAR_ST)]; 
sel_sym=[sel_sym  st_sym(:  ,ST AR_ST)] ; 

end;%====end  loop  for  each  starting  state====== 

[mi  metric  ml_pos]=max(sel_metric); 

ml_sym=sel_sym(:,ml_pos)'; 

min_dis=-ml_metric; 
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APPENDIX  G  ITERATIVE  CIRCULAR  SHIFT  BCJR 
DECODING  ALGORITHM  CODE 


function  err_pb=bcjr(n,D,DIM,B_Size,B_Num,ns,stab,sym_tab) 


%Purpose:  Iterative  Circular  Shift  BCJR  using  the  Most  Reliable  State  Transition  as  the 
starting  point  for  deeoding. 

%lnput  Parameters 

%n:  n-ary  information  symbol 

%D:  Trellis  Depth 

%DIM:  Dimensions  of  the  signal  constellation 
%B_Size:  Information  sequence  length.  Can  be  a  vector 
%B_Num:  Number  of  information  sequences  tested 
%ns:Eb/N0(in  dB) 

%stab:  State  transition  table  for  this  trellis 

%sym_tab:  symbol  assignment  table,  generated  by  sym_asgn.m 

%ln  Function 

%TOT_ST:  Total  number  of  states  in  this  trellis. 

%full_txs:  Turn  sym_tab  in  TOT_STx  (n*3)  matrix  into  (S‘n)  x  DIM  matrix.  The  TOT_ST  rows-full_txs((i- 
1)‘TOT_ST+1:i*TOT_ST,  :)  are  the  symbols  assigned  to  the  TOT_ST  transmissions  when  input  is  i-1. 
i=1,2,...,n.  Symbols  are  represented  as  0  or  (+)(-)1  in  all  the  DIM  dimensions. 

%Output  Parameters 

%err_pb:  Is  the  bit  error  probability  averaged  over  total  number  of  B_Num  information  sequences. 

%Date:Jan  24,  1999  Xiangyu  Song 


global  TOT_ST  ST_TAB  TXS  ; 

TOT_ST=n''D; 

ST_TAB=stab; 

TXS=sym_tab; 
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EB=3/2; 

full_txs=fu_sym(n,D,DIM); 

err_pb=[]; 

for  b_size=1:size(B_Size,2)  o/„***************** 
B=B_Size(b_size); 
full_sym=repmat(full_txs,[1  1  B]); 

pb_bk=[]; 

[in_bit,in_sym,out]=enco(n,D,DIM,B,B_Num);%==Encoding== 
for  ns_no=1:size(ns,2)%***** 

N0=EB/(1 0''(ns(ns_no)/1 0));%==N0== 
var=sqrt(N0/2); 

noise=randn(1  ,DIM*B*B_Num)*var; 
rev=out+noise; 


err=0; 

forb_no=1:B_Num  %** 

rev_mat=repmat(rev((b_no-1  )*B*DIM+[1  :B*DIM]),[TOT_ST*n  1]); 
rev_mat=reshape(rev_mat,n*TOT_ST,DIM,B); 

dif=((full_sym-rev_mat).''2)/N0; 

dif=-sum(dif,2); 

dif=squeeze(dif); 

prob=exp(dif); 

%=====Use  Most  Reliable  state  transition  as  starting  point===== 

%===Circular  shift  the  received  sequence================== 

%===lnitilize  Alpha  &  Beta  as  the  Most  Reliable  State========= 

[maxr,  row]=max(prob,[],1); 

[maxc,col]=max(maxr); 

m_row=row(col); 

st_fr=m_row-floor((m_row-0.5)/TOT_ST)*TOT_ST; 
st_to=ST_T  AB(m_row); 
shift=col-1 ; 

alpha=zeros(B,TOT_ST);beta=zeros(TOT_ST,B); 

alpha(1,st_fr)=1; 

beta(st_fr,B)=1; 

prob_shift=[prob(:,[shift+1  :B])  prob(:,[1  :shift])];%shift=0.o.k 
prob=prob_shift; 
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%====Calculate  gama^ 


row=repmat([1  :T0T_ST],1  ,n); 

gama=zeros(TOT_ST,TOT_ST,B);%saving  time  than  gama=[]. 

gama_seq=eye(TOT_ST,TOT_ST); 

for  i=1:B 

s=sparse(row,ST_TAB,prob(:,i),TOT_ST,TOT_ST); 

s_full=full(s); 

gama(:,:,i)=s_full; 


end; 

delta=10; 

%=====Forward  and  Backward  recursion=========== 

while  delta>10''(-3)%===Stop  Condition============ 

fort=2:B 

alpha(t,:)=alpha(t-1  ,:)*gama(:,:,t-1 ); 
ifalpha(t,1)<10''(-250) 

alpha(t,:)=alpha(t,:)/sum(alpha(t,:)); 

end; 

beta(:,B-t+1)=gama(:,:,B-t+2)*beta(:,B-t+2); 
if  beta(1,B-t+1)<10''(-250) 

beta(:,B-t+1)=beta(:,B-t+1)/sum(beta(:,B-t+1)); 

end; 

end; 

alphabp1=alpha(B,:)*gama(:,:,B); 

alphabp1=alphabp1/sum(alphabp1); 

betazr=  gama(:,:,1)*beta(:,1); 
betazr=betazr/sum(betazr); 

delta=max(abs(alpha(1  ,:)-alphabp1 )); 

ifdelta>10''(-3) 

alpha(1,:)=alphabp1; 

beta(:,B)=betazr; 

end; 


end;%===End  of  while 
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%====Calculate  sigama============================ 

mat=0:TOT_ST:(B-1  )*TOT_ST; 
addmat=repmat(mat,TOT_ST*n ,  1 ); 
pos=repmat(ST_TAB(:),1,B)+addmat; 
exp_alpha=repmat(alpha,1,n); 
exp_alpha=exp_alpha'; 

siga=exp_alpha(:).*prob(:).*beta(pos(:)); 

siga_mat=reshape(siga,TOT_ST,n,B); 

sum_mat=sum(siga_mat); 

[i,j]=max(sum_mat); 

%====Decode  and  shift  back=========================== 

deco_sym_shift=squeeze(j)'-1 ; 

deco_sym=[deco_sym_shift(B-shift+1  :B)  deco_sym_shift(1  :B-shift)]; 


ft_bt=bitshift(deco_sym,-1 ); 
sd_bt=deco_sym-ft_bt*2; 

err_b=size(find((ft_bt-in_bit((b_no-1)‘2*B+[1:2:2*B-1]))~=0),2)+size(find((sd_bt-in_bit((b_no- 

1)*2*B+[2:2:2*B]))~=0),2); 

err=err+err_b; 

end;%** 


pb_ns=err/(log2(n)*B*B_Num); 

pb_bk=[pb_bk,pb_ns]; 

end;%*““ 

err_pb=[err_pb;pb_bk]; 

**■***■****■***■****■***■*** 
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